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The Veterans Administration (VA) established the 
Readjustment Counseling Program in 1980 to assist Vietnam era 
veterans who had not made a successful psychosocial adjustment to 
civilian life. The program was intended to make services available at 
vet centers for veterans reluctant to seek counseling from regular VA 
health care facilities. At the request of Sena'.or Frank Murkowski, 
the General Accounting Office (GAO) reviewed specific aspects of the 
Readjustment Counseling Program to: (1) evaluate the need for 
retaining vet centers in community-based settings; (2) provide 
information on characteristics and problems of clients, services 
provided, staffing, end vet center relations with other agencies and 
the community; and (3) assess program management, oversight, and 
recordkeeping. Based on findings of the study, the GAO recommended 
that the VA should be able to decide on a case-by-case basis whether 
vet centers should be relocated to existing VA facilities. Clients 
were found to have motivational or behavioral problems. Centers were 
found to offer individual and group counseling and employment and VA 
benefits assistance. The centers had established extensive community 
networks for outreach and referrals. Most staff members had relevant 
academic, military, and professional experience. Improved monitoring 
of centers' activities was considered necessary to help ensure the 
provision of quality care. (Findings discussed in detail, 10 
tables and 19 figures are included, and relevant materials are 
appended. ) (NB) 
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United States 

General Accounting Office 

Washington, D.C. 20548 



Human Resources Division 

B-227618 

August 26, 1987 

The Honorable Frank H. Murkowski 
Ranking Minority Member 
Committee on Veterans' Affahs 
United States Senate 

Dear Senator Murkowski: 

This report discusses the Veterans Administration's Readjustment Counseling Program in 
response to a request of the former Chairman of your Committee. We comment on the need to 
relocate the program's vet centers from their storefront locations to existing va health care 
facilities. We also discuss program management issues and characteristics of veterans served 
by vet centers. 

Copies of this report are being sent to the appropriate congressional committees; the 
Administrator of Veterans Affairs; the Director, Office of Management and Budget; and 
other interested parties. 

Sincerely yours, 




for 

Richard L. Fogel 

Assistant Comptroller General 
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Executive Summary 



In fiscal year 1980, the Veterans Administration (va) established the 
Readjustment Counseling Program to assist Vietnam era veterans who 
have not made a successful psychosocial adjustment to civilian life. The 
program was intended to make services available at vet centers for 
those veterans reluctant to seek counseling from regular va health care 
facilities. 

The former Chairman of the Senate Committee on Veterans' Affairs 
(Senator Alan Simpson) requested that gao review specific aspects of 
the Readjustment Counseling Program to (1 ) evaluate the need for 
retaining vet centers in community-based locations; (2) provide informa- 
tion on the characteristics and problems of clients who have sought 
readjustment counseling; services provided; vet center staff qualifica- 
tions; and centers' relations with va medical centers, community pro- 
grams, Vietnam veterans, ard the public; and (3) assess program 
management, oversight, and recordkeeping. 



R ^w rni n a va's Readjustment Counseling Service operates the Readjustment Coun- 

oaCKgrOUna seling Programj which includes 188 vet centers around the country and 

costs, annually, about $40 million.' The centers are in storefront loca- 
tions in their communities, apart from established va facilities. They 
provide counseling and other services to clients, the majority of whom 
are Vietram era veterans. Most centers are headed by a team leader, 
with one o three counselors and clerical support. 

By law, va is required to take appropriate steps, during a 2-year period 
beginning October 1, 1987, to ensure the orderly transfer of the majority 
of vet centers from storefront locations to existing va facilities. As of 
July 1, 1987, the Senate had passed legislation to postpone the beginning 
date by 1 year; the House of Representatives had passed legislation 
making the relocation optional rather than mandatory. 

Each vet center is assigned to a va support facility (usually a medical 
center), which provides administrative support. A vet center's staff is 
required to collaborate with its support facility staff on clinical issues. 
Thirteen va medical centers have special inpatient units to treat veter- 
ans with posttraumatic stress disorder (ptsd), a clinical condition char- 
acterized by psychiatric symptoms that occur after military combat or 
exposure to other stressful events. The vet centers are required, when 
appropriate, to work closely with these units. 
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GAO obtained statistical information about client characteristics from the 
program's data base, gao also mailed a questionnaire to all vet centers, 
made extensive site visits to 12 vet centers, observed staff and client 
activity at 6 additional centers, and reviewed the oversight activity at 
three of the program's seven regional offices, gao's findings, based on 
the 12 centers, are not statistically representative of the entire program. 



ReSllltS in Brief Assuming the program can respond to changes in geographic factors and 

demands, gao believes that va should be able to decide on a case-by-case 
basis whether vet centers should be relocated to existing va facilities. 
There were no compelling reasons, concerning the cost or quality of 
counseling services or veterans' access to them, for va to be required to 
provide the services primarily through existing va facilities. 

There has not been a significant change in the personal characteristics 
of clients since the program began. Most served during the Vietnam era 
and appeared to have motivational or behavioral problems. For these 
problems, the centers offered an array of services, including individual 
and group counseling and employment and va benefits assistance; the 
centers had established extensive community networks for outreach and 
referrals. Most centers' staffs had the academic, military, and profes- 
sional experience that va considered relevant, although many had been 
in their positions for less than 1 year. 

Improved monitoring of centers' activities is needed to help ensure that 
they provide quality care. 



Principal Findings 



Future Location Relocating vet centers to existing va facilities will probably not signifi- 

cantly reduce program costs, and veterans' physical access to vet cen- 
ters did not seem to be an issue. Veterans' use of services would 
decrease if the centers were relocated to existing va facilities because of 
the veterans' distrust of va (and other reasons), according to many vet- 
erans and vet center officials. The quality of the services could also be 
adversely affected by such a relocation, according to officials of va and 
veterans 1 service organizations. Therefore, gao believes va should be 
allowed to decide on a case-by-case basis where vet centers are located. 
(See ch. 2.) 
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Client Characteristics According to information obtained from va's data base, over 305,000 cli- 

ents had been seen at vet centers as of September 1985, the most recent 
data available at the time of gao's review. The majority were unem- 
ployed white males, 31 to 40 years old, with at least a high school or 
equivalent education. Nearly 90 percent served in the military during 
the Vietnam era. Psychological (including anxieties and fears, low self- 
esteem, and survivor guilt), employment, or interpersonal problems 
were the ones the clients most frequently reported. The average number 
of new clients seen by each center has been increasing since fiscal year 
1982 but has not yet reached the peak of fiscal year 1981. (See ch. 3.) 



Staff Qualifications The majority of team leaders and counselors had master's or doctoral 

degrees in social work, counseling, or counseling psychology, with more 
than 4 years of related professional experience. Most staff were Viet- 
nam era veterans. Although the regional offices gao visited conducted 
training as required, between one-quarter and one-half of newly hired 
team leaders indicated *hat they did not receive orientation training on 
many topics. (See ch. 5.) 



Services Offered The centers offered an array of counseling services, including individual 

and group counseling for vetergns and their spouses, marriage and fam- 
ily counseling, and substance abuse counseling. Most centers also 
offered assistance for clients' problems with employment and general 
welfare, including obtaining va benefits. In addition, some of the centers 
gao visited sponsored therapeutic recreational activities for their cli- 
ents. (See ch. 6.) 



Outreach and Referral Nearly all centers had a wide variety o/ services in their local areas to 

use for referrals. These services were provided by other va facilities; 
veterans' organizations; and community social service, employment, and 
legal assistance agencies. In addition, centers used this network as a 
source of clients. However, officials at nine of the centers acknowledged 
that their follow-up of clients was often not done or was dependent on 
the judgments of individual counselors. (See ch. 6.) 



Centers routinely collaborated with their va support facilities on admin- 
istrative and clinical matters. However, only half of the centers located 
80 or more miles from their support facilities had clinical collaborations 
in fiscal year 1985. Training was also adversely affected by distance. 



Relations With Other VA 
Facilities 
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Although nearly all centers identified clients needing inpatient ptsd 
care, most were not referred to a ptsd unit. Moreover, once a center 
referred a client to a unit, there was little contact between the two facili- 
ties to assure that the veteran received appropriate care. (See ch. 7.) 



Management Problems va used several methods to communicate with and monitor the centers. 

However, regional program managers did not visit centers as frequently 
as required. Site visits were a critical mechanism for monitoring the ser- 
vices provided, but were not always conducted because of staff 
shortages and time demands. (See ch, 8.) 

va discontinued use of the program's data base in January 1986 because 
of a series of technical problems; therefore, many new clients seen dur- 
ing fiscal year 1985 were nco documented in the data base. In addition, 
the data on certain contacts reported by vet centers were not consistent. 
Thus, the data are of little use for decisions about the need for particu- 
lar centers. (See ch. 4.) 

va has not reviewed the quality of the counseling the centers provided. 
The program's regional staff reviewed clinical files during their site vis- 
its, but review procedures were not specific, gao also questioned the 
adequacy of documentation in these files. (See ch. 9.) 



Matter for The Con § ress should consider permitting va to ^ Jde on a case-by-case 

^ , basis whether to move the centers from their current locations. 

Congressional 
Consideration 



Recommendations GA0 is makin § several recommendations to improve management and 

oversight of the Reac^justment Counseling Program. 



Agency Comments In a letter dated June n > 1987 > the Administrator of Veterans Affairs 

endorsed gao's matter for congressional consideration. The Administra- 
tor said this would permit va to consider each center's changing needs 
and the method and location best suited to meeting those needs. The 
Administrator also concurred with the gao recommendations to improve 
the program's management and oversight and described a number of 
actions that va has taken and plans to take. 
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Chapter 1 

Introduction 



In fiscal year 1980, the Veterans Administration (va) began the Read- 
justment Counseling Program, opening community facilities, known as 
vet centers, to assist Vietnam era veterans' 1 adjustment to postwar civil- 
ian life. The veterans' families and "significant others" 2 could also be 
assisted, if necessary, in dealing with veterans' adjustment. Many veter- 
ans who served ^n Vietnam experienced readjustment problems result- 
ing in family difficulties, unemployment, alcohol or drug dependency, 
and other forms of social or economic impairments. These veterans were 
often reluctant to seek evaluation or treatment from established va facil- 
ities. The Readjustment Counseling Program was designed to overcome 
this reluctance by making va's mental health services available to these 
veterans on an outpatient, storefront basis, avoiding the implication of 
mental illness. As c* April 1987, 188 vet centers hrj been opened. 

The services provided at the centers normally have included individual 
and group counseling; assistance with employment, military discharge, 
and va benefits; and referrals to community and government agencies. 
Under certain circumstances, va has provided readjustment counseling 
services to veterans through contracts with private providers. With the 
exception of those who received dishonorable discharges, all veterans 
who served during the Vietnam era (Aug. 1964-May 1975) are eligible 
for the program's services. In fiscal year 1985, va spent $38.7 million for 
the program, including $7.3 million for services provided by private 
providers under contract to va. T*he budget for fiscal year 1987 was 
$40.7 million, including $5.6 million for contracts. 



DmrtVQTY , t>q rni 1T1 H The program was authorized by the Veterans' Health Care Amendments 
rrogl dill DdCKgl UUIIU Qf ig?g (Pu5Hc Law 96 _ 2 2, June 13, 1979). The Congress amended the 

legislation three times (Public Law 97-72, Nov. 3, 1981; Public Law 98- 
160, Nov. 21, 1983; and Public Law 99-576, Oct. 28, 1986). See Chapter 2 
for a discussion of the effect of these amendments on relocation of the 
Readjustment Counseling Program from one based in storefront loca- 
tions to one based primarily in existing va facilities. 

In fiscal year 1985, the Congress directed va to allocate an additional 
220 staff years to (1) expand the Readjustment Counseling Program by 



Although the readjustment problems were generally attributed to veterans who had experienced 
combat in Southeast Asia, the program is available for any veteran who served diring the Vietnam 
era. 

2 A term used to designee anyone other than a spouse or child who is significant in the veteran's life. 
The term can include the veteran s b »*lfnend or boyfriend, other close fnends, and parents. 
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augmenting staff at existing centers and (2) establish new centers at 
locations with the greatest need, va used most of the additional staff 
years to establish 52 new centers. No further expansion is planned. 



Program Structure and The Rea <*i u stment Counseling Program is managed by the Department 
0r<*flni7fltinn of Medicine and Surgery's (dm&s's) Readjustment Counseling Service at 

° £lUUU VA s antral office. The Readjustment Counseling Service director reports 

to dm&S's director for Operations and is assisted by a staff, including two 
field managers (not located at the central office) responsible for the 
oversight of the pro* jssional aspects of the program. 

The director has delegzted much of the management responsibility to 
the seven program regional offices.^ Generally, each regional office is 
headed by a regional manager and includes a professional staff consist- 
ing of a deputy regional manager and associate regional managers for 
Administration and Counseling. The staff responsibilities include moni- 
toring how the centers deliver services, training program staff, enhanc- 
ing relations with other va facilities, and assessing program 
performance. 

The 188 vet centers operate within the program's regional structure. 
Mcst are headed by a team leader, with two to three counselors and cler- 
ical support. Twenty-seven of the centers are satellites; they generally 
have smaller staffs and are headed by a coordinator who reports to a 
team leader at anoiaer center. Vet centers also rely on volunteers, work- 
study students, an other supplementary staff. Although located apart 
from established va iacilities, each vet center is administratively 
assigned to a va support facility (usually a medical center), which pro- 
vides -uch services as purchasing supplies, paying the bills, and main- 
taining the payroll. Vet centers and their support facilities are also 
expected to collaborate on clinical and other professional matters. 



Objectives, Scope, and 
Methodology 



The former Chairman 0 f the Senate Committee on Veterans' Affairs 
(Senator Alan Simpson) requested that we examine specific aspects of 
the Readjustment Counseling Program. We subsequently agreed with the 



of vZrTZl Jr , If K Ct fr ° m the reg,0nal off,ces for both VA ' S DM&S and Department 
Irn u f, began our review ' there were s« Prog™ rog.onal offices. The regmns 

were subsequently realigned, and a seventh was estabhshea on July 1 1986 
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Chairman's office to review che (1) need to retain the centers in commu- 
nity-based locations; (2) number, characteristics, and problems of veter- 
ans who use vet centers; (3) services provided by the centers and the 
qualifications and training of the staff; (4) management, oversight, and 
recordkeeping of the program; (5) centers' coordination with post-trau- 
matic stress disorder 4 (ptsd) units; and (6) centers' relations with va 
medical centers, community treatment programs, veterans, and the pub- 
lic!. (App. I includes the Chairman's request letter.) 

Our report provides detailed information on the above issues, but does 
not address program effectiveness. Although the Chairman requested us 
to assess effectiveness, we agreed with his office not to do so because va 
was preparing reports on the program's effectiveness and on the fre- 
quency of certain psychological and reacyustment problems in the Viet- 
nam theater veteran population as compared with Vietnam era 
nontheater veterans and nonveterans. The first report, issued on July 9, 
1987, concluded that the program has been effective and successful. 

To accomplish our objectives, we visited the Readjustment Counseling 
Service in va's central office, three of the program's regional offices, 
four vet centers in each of those three regions, and the va support facil- 
ity for each center visited (see table 1.1). We also interviewed represent- 
atives from several veterans' organizations. 



Table 1.1: Regional Offices, Vet Centers, 
and Support Facilities 



Regional office 


Vet center 


Support facility* 


Providence, Rl 
(region I) 


Springfield, MA 
Bangor, ME 
Pawtucket, Rl 
Boston, MA 


Northampton, MA 
Togus, ME 
Providence, Rl 
Boston, MA 


Bay Pines, FL 
(region III) 


Greenville, SC 
Jackson, MS 
St. Petersburg, FL 
Knoxvilie, Ti\ 


Columbia, SC 
Jackson, MS 
Bay Pines, FL 
Nashville, TN 


Los Angeles, CA 
(region VI) 


San Jose, CA 
Las Vegas, NV 
Oakland.CA 
Albuquerque, NM 


Palo Alto, CA 
Las Vegas, NV 
Martinez, CA 
Albuquerque, NM 



clinic 



Between January and June 1986, we visited the 12 centers. All had been 
operating before December 31, 1983. We selected some located in urban 



4 ! > ost-traum«tic stress disorder is a syndrome that a person may develop after having experienced a 
severely stressful or traumatic event It is more fully described in chapter 7. 
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areas and some in rural areas, some geographically close to their sup- 
port facilities and some geographically distant. We also selected three 
centers affiliated with medical centers that housed itsd units and one 
center whose support facility was an outpatient clinic. In addition, we 
included centers serving areas with significant minority populations. To 
the extent practical, the above characteristics were represented in our 
sample in the same proportion they were represented in all centers that 
opened before December 31, 1983. Although we believe that the offices, 
vet centers, and support facilities we reviewed (table 1.1) represent a 
valid cross section, our findings cannot be projected to the entire pro- 
gram (including 7 regional offices, 188 vet centers, and the related sup- 
port facilities). 

At va's central office and each regional office visited, we interviewed 
program managers about program requirements as well as their over- 
sight responsibilities and views on the continued need for community- 
based locations. We also examined program guidance^ and monitoring 
reports. 

To determine whether there was a continuing need for retaining the vet 
centers in their storefront locations, we (1) reviewed the legislative his- 
tory of the Readjustment Counseling Program and (2) discussed the 
issue with the director of the Readjustment Counseling Service, officials 
at the vet centers and support facilities we visited, and representatives 
of veterans' service organizations. We also solicited the opinions of vet 
center clients during our visits to the 12 vet centers. 

At each vet center, we interviewed the team leader and other center 
staff on all facets of the program; reviewed pertinent documentation, 
including a sample of clinical records; observed center activities; con- 
tacted local government and community service agencies; and obtained 
clients' views on the preferred location for the Readjustment Counseling 
Program. At each vet center's support facility, we interviewed appropri- 
ate officials to discuss administrative and clinical relations between the 
two facilities. 

In addition to the above site visits, we made 1-day unannounced visits to 
six centers to observe the activities of clients and staff. The centers vis- 
ited were in Avon and Brighton, Mass.; Baltimore, Md.; Oak Park, 111.; 
Reno, Nev.; and Concord, Calif. Generally, these centers were selected 

5 This term refers to the 1982 Program Guide, issued by the Readjustment Counseling Service, as well 
as various policy memoranda and other communications issued to vet centers and regional offices. 
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because they were convenient for our staff. The results of these visits 
are not projectable to these vet centers or the program. 

To supplement our site visits, we mailed a questionnaire to all vet cen- 
ters to obtain information mainly about the staff and the centers 1 fiscal 
year 1985 activities. All centers responded to the questionnaire. We also 
obtained statistical information about program clients from the pro- 
gram's computerized data base. 6 To assess the accuracy of the data base, 
we randomly selected and reviewed a total of 100 client files from the 12 
centers visited. We compared the source documents in each file with 
informatioxi in the data base. To determine how the documents were 
prepared, we interviewed center staff who completed the source docu- 
ments; we also interviewed central office and regional office managers 
about their perceptions of the data base accuracy. 

Appendix II describes some characteristics of vet centers as reported in 
responses to our questionnaire. Appendix III describes our questionnaire 
design and methodology, and appendix IV describes the methodology 
used to sample client files and determine the data base accuracy. (Ch. 4 
includes our assessment of the data base accuracy.) 

Our review, done between March 1985 and August 1986, was in accord- 
ance with generally accepted government auditing standards. 



G The computerized data base was discontinued n. January 1986 and replaced by a manual system in 
October 1986 
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VA Should Have More Flexibility in Deciding 
Where Vet Centers Are Located 



The major issue the former Chairman of the Senate Committee on Veter- 
ans' Affairs asked us to address is the need for retaining the vet centers 
in storefront locations. Current law retires that, by October 1, 1989, 
the Readjustment Counseling Program be based "piimarily" in va medi- 
cal centers. In enacting the initial legislation requiring the relocation of 
vet centers, the Congress recognized the need for some flexibility for va 
in deciding on the location of vet centers. The law allows vet centers to 
remain in storefront locations on an exception basis, such as where 
there is a substantial demand for readjustment counseling services and 
the va medical center could not absorb the counseling workload. 
Recently, the Senate Committee on Veterans' Affairs, in advocating an 
extension of the relocation date, adopted the following position, taken 
by va's general counsel: the "primarily" criterion requires that by the 
end of the relocation period a majority of vet centers must be operated 
at existing va facilities. The House, on the other hand, passed legislation 
making the relocation optional rather than mandatory. 

We reviewed the reasons for the establishment of the vet centers; opin- 
ions of va and veterans' service organization officials on the vet centers' 
location; and the effect a change in the program would have on the cost, 
quality, and availability of services. Based on this review, we believe 
that va should be able to decide on a case-by-case basis where vet cen- 
ters are located. There does not appear to be much to gain by moving vet 
centers to va medical centers. The requirement that services be provided 
"primarily" through traditional va facilities limits va's flexibility to 
judge the location of each center on its own merits, even if "primarily" 
is interpreted to mean "majority." Therefore, we believe the Congress 
should consider permitting va increased flexibility to decide whether to 
relocate vet centers. 



Legislative History of 
the Requirement to 
Relocate Vet Centers 
in Existing VA Health 
Care Facilities 



The vet center concept was designed to overcome the reluctance of 
many Vietnam era veterans to seek counseling for their readjustment 
problems from the va system. Although the original legislation (Public 
Law 96-22, June 13, 1979, codified as 38 U.S.C. 61 2A) did not specify 
that the program was to be operated through storefront locations, va 
informed the authorizing committees of its intention to do so: 

"The readjustment counseling programs will be located in the local communities 
with easy access for the Vietnam era veteran population. They can operate from 
independent store fronts, college campuses, offices within community mental health 
centers and offices within other sympathetic organizations." (Hearings before the 
Senate Committee on Veterans' Affairs, Jan. 25, 1 979) 
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The 1981 amendments to the original legislation (Public Law 97-72, Nov. 
3, 1981) called for the relocation of the Readjustment Counseling Pro- 
gram from a storefront-based program into one based "primarily" in 
existing va health-care facilities. 1 The relocation was to take place dur- 
ing fiscal year 1984. In its repo~ on that legislation, the House Veterans' 
Affairs Committee said it wanted closer supervision by the va medical 
center directors and chiefs of staff; the Committee indicated, however, 
that it was not opposed to a continuance of the storefront program. Nev- 
ertheless, va noted: 

"While there were sound reasons for implementing VA's readjustment counseling 
authority through a community-based delivery and referral mechanism, it was 
never intended that the Outreach Center be other than a short-term facility. Nor 
was it intended to be offered indefinitely." (Letter to the Chairman, House Commit- 
tee on Veterans' Affairs, Apr. 9, 1981) 

According to the statement explaining the compromise agreement, VA 
would not be prohibited from continuing to operate some vet centers 
after the relocation date, 

"particularly in areas where the demand on the vet center is expected to remain at a 
high level and the other VA health-care facilities in the immediate area would not be 
able to absorb easily a significant increase in demand for services." 

The 1983 amendments (Public Law 98-160, Nov. 21, 1983) extended the 
relocation period to fiscal year 1988; the 1986 amendments (Public Law 
99-576, Oct. 28, 1986) extended it to fiscal year 1989 and provided that 
the relocation take place in an "orderly and gradual" manner over the 
course of 2 years, rather than 1 year. 

The current Congress has before it several legislative proposals on both 
the timing and nature of the relocation of vet centers to existing va 
health-care facilities. Section 201 of S. 477, passed by the Senate on 
March 31, 1987, would provide for a 1-year postponement (from Sept. 
30, 1989, to Sept. 30, 1990) of the date by which the Readjustment 
Counseling Program would complete the relocation. The legislation 
would also require that the program provide readjustment counseling 
services "primarily" through existing va health-care facilities. In dis- 
cussing the legislation, the Chairman of the Senate Committee on Veter- 
ans' Affairs said that his Committee agreed with the interpretation of 



1 We use the term "existing VA health-care facilities ' to refer to what the law calls "the health care 
facilities operated by the Veterans Administration for the provision of other health care services M 
These facilities include the 172 VA medical centers and 58 outpatient clinics not located at medical 
centers 
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va's general counsel that the "primarily " criterion requirec that by the 
end of the period a "majority" of vet centers must be operated at tradi- 
tional va facilities. On August 7, 1987, the Committee's Ranking Minority 
Member introduced S. 1646; section 301 of this proposal would also 
postpone for 1 year the date by which the relocation should be 
completed. 

On July 15, 1987, the Committee Chairman and 10 other Senators intro- 
duced S. 1501 that would, among other things, replace the relocation 
provision of the existing law with one permitting closing or relocation of 
a vet center only on the following determination by the chief medical 
director, based on the application of certain criteria: that such a closing 
or relocation would not result in any diminution in the continuing avail- 
ability and effective provision of readjustment counseling needed by 
veterans and others entitled to such services in the geographic area. 

H.R. 2616, passed by the House on June 30, 1987, would (1) make the 
relocation of vet centers optional rather than mandatory, and (2) 
require that va operate the same number of free-standing vet centers on 
October 1, 1988, that it operated on April 1, 1987. va had announced 
plans to relocate nine vet centers to va medical centers during fiscal year 
1987 because, according to the chief medical director, "it would be wise 
to proceed with this small-scale relocation ... to allow the agency to 
gain experience and information which will be useful in planning the 
full transition required by law." On June 29, 1987, the U.S. District 
Court for the District of Columbia, acting on a suit filed by the Vietnam 
Veterans of America, eryoined va from closing the centers. 



DM&S Plans to Keep 
Vet Centers in 
Storefront Locations 



None of the vet centers are located in existing va health-care facilities. 
About 45 percent of the centers are housed in multioffice commercial 
space, 31 percent in single-office commercial buildings, 14 percent in 
residential settings, 6 percent in shopping centers, and the remainder in 
other settings. 

In July 1984, va's chief medical director established the Vet Center Plan- 
ning Committee to develop options for the future of the centers. The 
committee, a dm&s group comprised of va central office and field mana- 
gers, considered five options: 

Option I : Continue the present system after fiscal year 1988, with no 
major alterations in organizational structure, services offered, or eligi- 
bility. Phase down the contracts portion of the program, redirecting 
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those resources into existing centers. Adjust center resources, closing 
down centers or relocating them in va medical centers or outpatient clin- 
ics, if appropriate, based on changes in geographic factors and demand. 
Reduce management units. 

• Option II : Convert the centers during fiscal year 1988 into general out- 
patient clinics or community-based centers by adding services such as 
specialized counseling and medical and surgical services. 

• Option HI : Beginning in fiscal year 1988, integrate centers into psychia- 
try services and decide the centers' locations as appropriate. 

• Option IV : Defer the decision until 1987. In the meantime, conduct a 
pilot program to test a model for merging vet center services with other 
dm&s services. 

• Option V : Incorporate the Readjustment Counseling Program as a pro- 
fessional service under the chief of staff va medical facilities and 
decide on appropriate location?. Place th.. program regional staff under 
the dm&s regional director. 

In December 1985, the committee recommended option i. A major aspect 
of this option was deciding on the location of an individual vet center, 
based on that center's changing pattern of utilization. According to the 
report, "Relocations may include locating a Vet Ceni ar within a VAMC 
[medical center] or VAOPC [outpatient clinic] if desirable according to 
local patterns of utilization." The committee stated that the Readjust- 
ment Counseling Program had been highly successful and effective, 
becoming an "integral and complementary part of the overall va health 
care delivery system." According to the committee, this success was a 
result of the highly committed and compassionate staff and the pro- 
gram's cost-effectiveness; in addition, the current organizational struc- 
ture had "probably significantly decreased morbidity and need for 
hospitalization." 

The committee recognized that although utilization of services in the vet 
centers had not shown any significant decrease, "the current organiza- 
tional structure of the program lends itself readily to downsizing at 
whatever rate is indicated by a future decline in need for services." 

On February 21, 1986, the chief medical director approved option I. 



We assessed the retaining of vet centers in storefront locations in terms 
of the potential effect of any change in location on the cost and quality 
of the care offered, as well as on veterans' access to that care. We found 
that (1) the relocation would probably not have a significant effect on 
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program costs; (2) veterans 1 access to readjustment counseling would 
probably not be significantly affected, but their willingness to seek that 
care might be lessened if the vet centers were absorbed into existing va 
facilities; and (3) according to many officials we interviewed, the quality 
of readjustment counseling would be adversely affected if the vet cen- 
ters were relocated to existing va facilities and the medical center staff 
provided the counseling instead of the vet center staff. 



Relocating the vet centers to existing va facilities will probably not have 
a significant effect on program costs. Overall, program funding is not 
expected to grow, remaining at about $40.5 million through fiscal year 
1 989. Salaries, the major program expense, were about 63 percent of the 
cost in fiscal year 1985. Staffing is expected to remain at 794 full-time 
employee equivalents through fiscal year 1989. 

Space rental and utility costs currently being incurred (about $3 million 
according to the program director) would be avoided if existing va facili- 
ties had extra space so that they could absorb the vet centers. If the 
receiving facilities could not physically absorb the vet centers, however, 
the facilities would have to incur additional costs to provide space 
(either by providing temporary quarters, such as in a trailer, or by leas- 
ing space in a nearby building). 

We did not obtain data on the costs incurred by individual vet centers 
because these data are maintained by the vet centers' support facilities 
and, when the support facility has more than one vet center, costs can- 
not easily be identified with a particular center. For example, of the 12 
vet centers we reviewed, 9 are connected to support facilities that serve 
more than one center. Of the nine support facilities, only one classified 
its costs so that all costs attributable to each center could easily be 
identified. 



va officials we interviewed were divided in their opinions about whether 
relocating vet centers to existing va facilities would adversely affect the 
access of most veterans to needed services. The majority of officials 
agreed, however, that the number of veterans willing to accept counsel- 
ing would drop if the vet centers relocated. 

At the 12 vet centers we visited, we asked the team leaders for their 
opinions on the effect of relocating their centers to existing va facilities. 



Page 19 



GA0/HRD-87-63 Vet Counseling Centers 



Chapter 2 

VA Should Have More Flexibility in Deciding 
Where Vet Centers Are Locate <i 



Six said the relocation would reduce the number of veterans conven- 
iently located near a vet center; this is so because the veterans would 
have to travel farther or to locations not served by public transporta- 
tion; six said the relocation would not reduce the number. We posed the 
same question to nine of the liaison officers at the vet centers' support 
facilities. Three agreed that relocating the program to their facilities 
would reduce access, and six disagreed. 

DM&s assumes that 50 miles (one way) is the maximum most veterans 
can be expected to drive for weekly visits. According to the Reacyust- 
ment Counseling Service director, there were 44 vet centers whose dis- 
tance from the closest existing VA medical center would be great enough 
to uiscourage current vet center clients from using the service if the cen- 
ters relocated. 

The number of veterans willing to accept counseling services would 
drop, according to all 12 team leaders and 7 of the 12 liaison officers we 
interviewed, if the vet centers moved to existing va facilities. These offi- 
cials attributed this mainly to the veterans' distrust of the va, va's lack 
of experience with and understanding of Vietnam veterans' problems, 
the perceived cold and impersonal environment at existing va facilities, 
and veterans' perceptions that if they go to an existing va facility they 
will be viewed as having a "sickness." The program director told us, 
however, that he has seen an improvement in the willingness of Vietnam 
era veterans to seek counseling at existing va facilities, but the change 
h?s been slow. 

To determine how clients felt about the issue of locating the vet centers 
in existing va medical centers, we did a nonscientific, nonprojectable sur- 
vey of clients who visited the 12 vet centers during our visits. Of the 
328 clients we surveyed, 53 percent said they would go to the vet center 
if it was located at the nearest va facility and run by vet center staff; 43 
percent said they would not go. Thirty-two percent said they would go 
to a va facility even if the program was run by the va facility staff 
rather than the vet center staff; 63 percent said they would not. The 
remaining clients did not express a definitive opinion. 



According to the officials of va and veterans* service organization that 
we interviewed, the quality and effectiveness of counseling services 
could be adversely affected by relocating the vet centers to the existing 
va facilities. Several veterans' service organization representatives and 
va officials told us that attitudes, both of veterans and other va facility 
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staff, would tend to reduce the effectiveness of the program, in terms of 
veterans' willingness to seek needed counseling and the quality of that 
counseling, if the centers were relocated to existing va facilities under a 
different organizational structure. 

va officials told us that if vet centers were moved to existing va facili- 
ties, the Readjustment Counseling Program would lose its autonomy; 
counselors would incur many restrictions conct rning their relations with 
clients (such as would be required in following a "medical approach"), 
and the program would no longer be a priority. The program director 
told us the following: Relocating the vet centers to existing va facilities 
could be detrimental to the quality of counseling services at some cen- 
ters. If the vet centers became part of the psychiatry service (option III), 
quality could decrease. The psychiatry service has several missions, 
but the Readjustment Counseling Program has only one; therefore, the 
uniqueness of the program would disappear. Incorporating most centers 
as an independent service reporting to the chiefs of staff (option V) 
could cJso negatively affect the quality and effectiveness of the 
program. 

Eleven of the 12 team leaders told us that the quality of services would 
decrease if center staffs were absorbed by the existing va facilities, 
becoming part of the psychiatry service. One team leader felt that qual- 
ity would increase with the relocation. Nine of the team leaders felt that 
quality would suffer if the vet center staffs were placed under the con- 
trol of the chief of staff. 

The ten liaison officers we questioned were split in their opinions about 
the effect relocating vet centers would have on the quality of counseling 
provided. Six agreed that placing vet center staffs under the psychiatry 
service would negatively affect the counseling services; four disagreed. 
Six liaison officers agreed that placing vet center staffs under the chiefs 
of staff would negatively affect counseling services; three disagreed, 
and one felt there would be no effect. 



Conclusions There does not a PP ear t0 be much t0 be gained by requiring that vet 

centers be relocated to existing va facilities. Costs would not be signifi- 
cantly reduced; some veterans willingness to seek counseling could be 
adversely affected; and, according to the majority of officials we inter- 
viewed, the quality of the counseling could suffer. 



^ Page 2 1 GAO/HRD-87-63 Vet Counseling Centers 



ERIC 



Chapter 1 

VA Should Have More Flexibility in Deciding 
Where Vet Centers Are Located 



Therefore, we believe that va ought to be able to decide on a case-by- 
case basis whether vet centers should be relocated to existing va facili- 
ties, given these program conditions: (1) if the program has proven to be 
an effective mechanism for caring for the readjustment problems of vet- 
erans and (2) if va can ac^just center resources to respond to the growing 
or diminishing needs for their services. Section 107(d) of H.R. 2616, 
passed by the House on June 30, 1987, or section 3(3) of S. 1501, intro- 
duced on July 15, 1987, would provide va flexibility in deciding whether 
to relocate individual vet centers to existing va health care facilities. 
Section 201 of S. 477 and section 301 of S. 1646 would give va more time 
to take appropriate relocation actions. 



Matter for 

Consideration by the 
Congress 



The Congress should consider permitting va to decide on a case-by-case 
basis whether to relocate vet centers from storefront locations to 
existing va facilities. 



Agency Comments 



In a letter dated June 1 1, 1987, the Administrator of Veterans Affairs 
endorsed our position. According to him, permitting va to determine 
whether or not to relocate a vet center to an existing va health care facil- 
ity on a case-by-case basis would permit va to consider each center's 
changing needs and the method and location best suited to meeting those 
needs. 
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Characteristics of Clients Served by the 
Readjustment Counseling Program 



The clients served by the Readjustment Counseling Program generally 
fit the profile of those veterans the Congress intended the program to 
serve. Most had been in the military during the Vietnam era. The major- 
ity were unemployed and did not have a bachelor's degree. About half of 
them were divorced, separated, or had never been married. For the most 
part, their problems (notably, nterpersonal, employment, and financial 
or housing) reflected this profile. However, counselors judged over one- 
quarter of clients' problems to be unrelated to their military service. 
Moreover, although some clients had numerous contacts with staff mem- 
bers, the majority did not sustain contact. 

The statistics cited in this chapter are from va's computerized program 
data base, which describes the number and characteristics of clients 
served, va maintained the data base from the program's inception until 
January 1986. The statistics presented here are as of September 1985, 
the most recent data available at the time of our review. We assessed the 
data base accuracy, concluding that the number of clients served and 
client contacts made were questionable. The results of our assessment of 
the data base are described in chapter 4. 



Vet Centers Served 
Over 305,000 Clients 



To fairly represent client workload, these figures exclude centers during 
the years they were not fuiiy operational. The number of clients seen 
was relatively high in fiscal year 1981 because staff may have spent 
more time attracting clients than treating them, the program director 
suggested. 



According to the data base, 305,000 clients had been seen in vet centers. 1 
The average number of new clients seen increased between fiscal years 
1982 and 1984, but did not reach the peak of fiscal year 1981, as illus- 
trated in figure 3.1. 



Fiscal year 1985 was not included in figure 3.1 because a large number 
of clients were probably not documented in the data base that year (see 
ch. 4). However, based on the centeis' manual counts of clients seen dur- 
ing a 9-month period in fiscal year 1985, we projected that the average 
number of clients seen that year per center was 486. 



'This is out of a total Vietnam era veteran population of 8.3 million 

n 
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Figure 3.1: Average Number of New 
Clients Seen Per Vet Center (Fiscal Years 
1981-84) 
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Source VA Readjustment Counseling Program data base 



Client Profile Changed 
Slightly Since the 
Beginning of the 
Program 



Ninety-eight percent of all clients in the data base who came to vet cen- 
ters were male. The characteristics of the client profile for those who 
first visited vet centers in the program's more recent years changed 
slightly from those of clients whose first visit was during the earlier 
years, as shown in figures 3.2 to 3.6. 

The median age of new clients was generally consistent with the median 
age, £s of September 1984, of all Vietnam era veterans. In addition, 
approximately the same percentage of female veterans came to vet cen- 
ters as served during the Vietnam era. However, as compared with all 
Vietnam era veterans, the vet centers saw a proportionally higher 
number of black veterans (9 percent of all Vietnam era veterans were 
black), unemployed veterans (the average monthly unemployment rate 
for male Vietnam era veterans between January 1980 and September 
1984 was 7.1 percent), and veterans with less than 4 years of college 
(about 22 percent of male Vietnam era veterans had 4 years or more of 
college as of the early 1980's). 
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Figure 3.2: Readjustment Counset. , 



Program Client Profile— Age (Fiscal Years Anp 
1980-85) y 
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Source VA Readjust' nent Counseling Program data base 



Clients Generally 
Vietnam Era Veterans 



The program's authorizing legislation states that the Readjustment 
Counseling Program is intended for veterans who were on active duty 
during the Vietnam era. Eleven percent of vet center clients did not 
serve during that period. The program director said that he, the regional 
nnagers, and the deputy regional managers he talked to expected that 
percentage to be lower. He said, however, that if a non- Vietnam era vet 
eran, especially one who served in combat, had significant psychological 
problems, then counselors had a moral responsibility to assist that v«t- 
Tan a few times. The director added that non- Vietnam era veterans 
with no significant problems should have been referred elsewhere. 

We could not determine from va's data ba^e the percentage of clients 
who served in a combat S* Uus. The data base did indicate that 56 per- 
cent of clients served in combat; the remainder either did not serve in 
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Figut J 3.3: Readjustment Counseling ^■B^H^^H 
Program Client Profile— Marital Status Marital Status 
(Fiscal Years 1980-85) 
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Source. VA Readjustment Counseling Program data base. 



combat or did not have that information recorded. However, until fiscal 
year 1985 the data base did not distinguish between these clients. 

Combat service was never precisely defined: Until fiscal year 1985, vet 
center staff were instructed that discretion should be used in determin- 
ing combat service since any service in Vietnam could be considered 
combat. In fiscal year 1985, combat service was defined as service in a 
"war-zone theater." The Vietnam theater included Vietnam, Laos, Cam- 
bodia, and their contiguous waters and air space. 

We also could not de jrmine from the data base the total percentage of 
clients who had service-connected disabilities. The data base indicated 
that 23 percent of clients had a service-connected disability, and the 
remainder either did not have a service-connected disability or did not 
have that information recorded. Again, the data base did not distinguish 
between these clients. 
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Figure 3.4: Readjustment Counseling 
Program Client Profile— Race/Ethnic 
Origin (Fiscal Years 1980-85) 
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Source VA Readjustment Counseling Program data base 

During our visits to six vet centers to observe staff and client activity, 
we asked staff at each center to record, for all clients who came to the 
center on the day of our visit, whether the client (1) experienced hostile 
fire in combat situations in Southeast Asia and (2) had a service-con- 
nected disability. Of the 47 clients from whom the staff obtained this 
information, 37 had experienced hostile fire and 14 had service-con- 
nected disabilities. Of the 14 clients who had service-connected disabili- 
ties, 5 came to the center that day for a problem related to the disability. 



Clients Had 
Motivational or 
Behavioral Problems 



The Readjustment Counseling Program was established to deal with 
interpersonal (low-grade motivational or behavioral impairments affect- 
ing veterans' normal interpersonal relationships), employment (job or 
educational performance), or psychological (overall ability to cope rea- 
sonably effectively with daily life) problems. Most veterans seen at vet 
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Figure 3.5: Readjustment Counseling 
Program Client Profile— Education 

(Fiscal Years 1980-85) 
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centers appeared to exhibit these problems. The problems counselors 
most frequently reported their clients had during a first visit to a vet 
center are shown in figure 3.7. 



Clients' Problems 
Often Judged 
Unrelated to Military 
Service 



In fiscal year 1985, staff at the vet centers reported that, overall, 49 
percent of clients' problems were military-related, and 27 percent were 
not. The staff could not determine whether the remaining 24 percent of 
problems were mili* ry related. The problems were categorized as 
follows: 

ptsd : Includes symptoms such as intrusive recollections of a traumatic 
event, loss of interest in significant activities, sleep disturbances, trouble 
concentrating, and easily startled. 
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Figure 3.6: Readjustment Counseling 
Program Client Profile— Employment 

(Fiscal Years 1980-85) Employment 
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Source VA Readjustment Counseling Program data base 

• Post-trauma symptoms : Includes symptoms that do not indicate ptsd but 
are related to an identifiable stressful event. 

• Substance use disorder : Includes the abuse of or dependence on alcohol 
or drugs. 

• Psychosocial problems : Includes problems, such as marital difficulties, 
that are not mental disorders but do indicate a need for counseling or 
psychotherapy. 

• Noncounseling problems : Includes problems that require technical assis- 
tance, education, referral, or other noncounseling assistance, such as 
information about a discharge upgrade. 

• Other problem s: Includes undefined psychiatric disorders, anxiety, and 
antisocial behavior or other personality disorders. 

With the exception of ptsd and post-trauma symptoms, counselors 
reported many problems as being unrelated to clients' military service, 
as shown in figure 3.8. 
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Figure 3.7: Reported Client Problems MMBHHHHB 

(Fiscal Years 1980-85) 

100 Percent of Clients 



80 




1980 1981 1982 1983 1984 1985 

Fiscal Year 

— — Psychological 3 

• — Employment/Vocational 
• Interpersonal 

VA/Other Benefits 
— * mm Basic Needs 
••••••• Substance Abuse 

Source VA Readjustment Counseling Program data base 

Psychological problems include anxieties and fears; bad dreams, flashbacks, and intrusive 
recollections of a traumatic event; suicidal or homicidal behaviors, memory impairment, 
depression; low self-esteem; aggressive behavior; wandering life-style, loss of interest in 
significant activities; and survivor guilt. 



Most Clients' Relations 
With Vet Centers 
Short-Lived 

Fifty-five percent of the clients who, on the day of our visit, came to the 
six centers we observed had first come to that center within the previ- 
ous year. Eleven percent of the clients made their first vioit that day. On 
average, the clients had visited the center 15 imes during the previous 6 
months. 



In fiscal year 1985, half of all clients who came to a vet center that 
opened before October 1, 1984, were new clients that year. Moreover, 
the proportion of new clients who had three or fewer contacts with a 
center grew almost every year, as shown in figure 3.9. 



ERLC 



Page 30 



32 



GAO/HRD-87-63 Vet Counseling Centers 



Chapter 3 

Characteristics of Clients Served by the 
Readjustment Counseling Program 



Figure 3.8: Clients' Problems and 
Relation to Military Service 

(Fiscal Year 1985) 




Military-related Problems 
Nonmihtary-related Problems 



Source VA Readjustment Counseling Program data base 
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The Readjustment Counseling Program's computerized data base was 
established in fiscal year 1980 to (1) collect information for statistical 
analyses of Vietnam veterans, (2) generate management reports, and (3) 
determine the continued need for vet centers in particular locations. It is 
the most extensive single source of information about the number and 
characteristics of clients who used the Readjustment Counseling Pro- 
gram and the contacts they had with vet center staff. However, our 
assessment of the data base's accuracy indicated that information on the 
number of clients seen and contacts made was questionable. Moreover, 
throughout fiscal year 1985, the data base was so incomplete that it was 
discontinued, in January 1986, and replaced, in October 1986, with a 
manual system. 

To maintain the program's data base, vet center staff were required to 
submit to va's data processing center two types of forms for each client 
they served. The first was a data code sheet that requested information 
about a client's personal characteristics (such as date of birth and mari- 
tal status) and military service (such as period and branch of service). 
This form was to be submitted for every new client seen. The second 
form was a contact sheet that requested information about the problems 
affecting the client. It was to be submitted for face-to-face contacts, 
including the first contact with the client. The code sheet and contact 
sheet forms remained essentially unchanged from December 1979 until 
the start of fiscal year 19o5. At that time, both forms were expanded to 
include more detailed information. Clients in the data base are identified 
by a vet center-assigned number, not by name. 



Accuracy Of Client To 388688 the data base acourac y of client profiles (including personal 

Pro filPS and military service characteristics), we compared information in the 

data base with information in a total of 100 clinical files we sampled (at 
the 12 vet centers we reviewed); it was not practical for us to review a 
large enough sample of actual client records at the vet centers to be able 
to project the nationwide information the Senate Veterans' Affairs Com- 
mittee Chairman requested. (App. IV discusses the methodology we used 
to select the sample.) Our results are projectable only to active files at 
the 12 centers visited. We identified discrepancies between the data base 
and the code sheet (keypunch errors), as well as discrepancies between 
the data base and other documents in the clients' files. If there were no 
documents in a file with which to verify the data base, we assumed it 
was correct. We compared information on six personal characteristics 
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(sex, date of birth, race, marital status, education, and employment sta- 
tus) and two military service characteristics (period of service and ser- 
vice-connected disability status). 

Keypunch errors did not exceed 4 percent for any of the eight character- 
istics examined. Discrepancies between the data base and other docu- 
ments in the file did not exceed 3 percent for live of the characteristics. 
However, our review showed a discrepancy ratt of 7 percent for "date 
of birth," 14 percent for "education," and 16 percent for "service-con- 
nected disability status." (The projectability of these results is discussed 
further in app. IV.) The program director and regional officials indicated 
they believed that, generally; personal and military service characteris- 
tics in the data base were reasonably accurate. 

Except for identifying keypunch errors, we did not assess the accuracy 
of data base information about clients' problems because there was not 
sufficient documentation in the clients' files. Keypunch errors were less 
than 1 percent. The assistant regional managers for counseling in 
regions III and VI said they believed that the accuracy of the data on 
clients' problems was less than the accuracy of the data on their per- 
sonal and military characteristics; the assistant regional managers 
added that accuracy varied depending on the staff that completed the 
forms. Most of the team leaders we interviewed told us that they did not 
review contact sheets for clinl ^al accuracy. 



The results of our questionnaire and our review of sample files and 
other vet center records irdicated that the number of clients and client 
contacts in the data base is questionable. Vet center staffs did not con- 
sistently report contacts; they reported contacts that did not occur or 
that did not involve assistance to a client. Moreover, the number of cli- 
ents and client contacts in tlie data base did not always agree with vet 
center records. We could not determine whether, overall, the numbers in 
the data base were overstated, understated, or accurate. 

va's instructions for completing contact sheets required that they be 
completed each time a vet center staff member had a face-to-face con- 
tact with a veteran. The Readjustment Counseling Service director told 
us he never defined what a face-to-face contact was because he felt it 
was clear to program staff that only counseling sessions in which emo- 
tional problems were seriously discussed should be reported as contacts. 



Accuracy of Number 
of Clients and Client 
Contacts 
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However, in December 1986, after we discussed our findings with him, 
the director notified the regional managers that contacts with clients 
should not be reported as visits if they consisted primarily of social con- 
versations, recreational activities, or casual visits. Further, contacts 
should not be reported if a counselor only wiote a letter, made a phone 
call, or performed some other administrative activity concerning a 
client. 

The instructions for completing contact sheets further specified that a 
telephone contact with a veteran could be reported if a major change 
occurred. In August 1984, the instructions were clarified to require vet 
center staff to report telephone calls but only those involving counsel- 
ing, defined as "substantive communication with a client." The instruc- 
tions specifically excluded telephone calls that were 

"siir.ple greetings in nature, redirecting erroneous requests for assistance, 
rescheduling/cancelling/ confirming/reminding about scheduled appointments, or 
any other contact with a client or significant other that is not of a substantive direct 
services or consultative nature." 

The instructions did not explicitly address whether contact sheets 
should be completed for non-Vietnam era veterans or for veterans with 
dishonorable discharges. However, the code sheets did request informa- 
tion about clients' periods of service and discharge eligibility, suggesting 
that such clients and their contacts should have been reported. The 
Readjustment Counseling Service director said, however, he was not 
sure if vet center staff should fill out contact sheets for these veterans. 



Vet Center Staffs Did Not The results of our questionnaire indicated that, except for individual 
Consistently Document apd 8 rou P counseling, vet centers were not consistent in completing con- 

Client Contacts tact sheets in fiscal y ear 1985 » as shown in table 4. 1 . 
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Table 4. <: Vet Center Documentation of ^BH^H^H^^^M 

Counseling and Noncounseling 
Assistance Using Contact Sheets(Ftscal 
Year 1985)* 

Situation 

Counseling assistance 

individual sessions 



Scheduled 99 

Unscheduled 92 

Group sessions 96 

Telephone sessions 64 

Ses sions with dishonorably discharged Vietnam era veterans 56 

Sessions with non-Vietnam era veterans 54 

Noncounseling assistance 

Unscheduled visit 58 

Making an appointment for a new client 22 

Giving information on services 20 

Making an appointment for a current client 19 



a For vet centers that opened before October 1 , 1984. 



b 'Regularly" was defined to be at least 75 percent of contacts with veterans in each situation category 

Since we do not know how often each of the above situations occurred, 
we could not conclude whether the inconsistent reporting overstated or 
understated the data base. 



Percent of 
centers 
regularly 
documenting 
assistance* 



Staffs at Centers Visited 
Reported Contacts That 
Did Not Occur 



Thirty-five of the 100 sample files included contact sheets reporting a 
client visit or telephone session that did not occur or that did not involve 
providing assistance to the client, for example: 

Fifteen files included contact sheets that indicated a client visit occurred 
when the progress notes in the client's clinical file stated that a vet 
center staff member only mailed the client a follow-up letter. In one 
instance, a client file included four contact sheets. According to notes in 
the file, the initial contact was made by mail, and the subsequent con- 
tacts were follow-up letters. 

Six files, all from the same vet center, included contact sheets that indi- 
cated a client visit occurred; the progress notes, however, stated that the 
veterans only attended a group presentation by vet certer staff at the 
veterans' place of employment. The team leader told us contact sheets 
were completed because he expected several veterans attending the pre- 
sentation to come to the center afterwards. To be consistent, he said, a 
contact sheet was completed for each veteran in attendance. None of 
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these six clients had come to the center for services as of the time of our 
visit, over a year after the presentation was made. 
Six files included contact sheets that indicated a client visit occurred 
when the progress notes stated only that the clients made a casual visit, 
for example, to pick up a bumper sticker, drink coffee and socialize, or ' 
inform the staff of a job opportunity for other veterans. 
Four files included contact sheets that indicated a client visit or tele- 
phone session occurred when the progress notes stated only that a tele- 
phone contact with a third party was made. In one instance, a veterans' 
organization representative called a counselor to inform him that a cli- 
ent did not show for an appointment. 

Two files included contact sheets that indicated a client visit occurred 
when the progress notes stated one client missed his appointment and 
the other rescheduled an appointment. 

Thirty-four percent of the staff members (excluding employment coun- 
selors) we interviewed who filled out contact sheets told us they com- 
pleted contact sheets for casual visits because they (1) were important 
to the veterans' therapy, (2) may have been a client's way of asking for 
help, or (3) actually represented services provided. For example, the Las 
Vegas Vet Center team leader to!d us that a large percentage of that 
center's reported contacts were with homeless or transient veterans who 
used the center to shower, do laundry, read a newspaper, or just "hang 
out." He considered these as services offered to clients and, to account 
for all clients coming to the center, he said staff documented nearly all 
of them on contact sheets. Moreover, during region VI's June 1985 
regional training, center staff were instructed to prepare contact sheets 
for casual visits if the need for socialization, as part of the readjustment 
process, was documented in the client's treatment plan. Staff members 
COmp .! eted contact sheets for clients who attended group recreational 
activiities, such as Softball games, organized by the vet center; we were 
told this by 16 percent of the staff members (excluding employment 
counselors) we interviewed who filled out contact sheets; no examples, 
however, appeared in our sample. 

The above examples suggest that client contacts are overstated. How- 
ever, counselors at three centers told us that they did not always have 
lime to submit contact sheets for reportable contacts. The team leader at 
a fourth center said one of his counselors often did not complete the 
forms because he disliked paperwork. Generally, officials at these cen- 
ters told us they had procedures established to detect unreported 
contacts. 
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Statistics in the Data Base 
Did Not Agree With Vet 
Center Records 



At the 12 centers, we compared (1) the total number of clients seen 
according to the data base with the number according to vet center 
records and (2) for our sample files, the number of contacts reported in 
the data base with the number of contact sheets in the clinical files. The 
discrepancies we found indicated that the number of clients and con- 
tacts is inaccurate in the data base. 

The total number of clients seen at the centers visited was about 33,450 
according to the centers' records, but about 31,100 according to the data 
base. 1 At three centers, the number of clients in the data base was more 
than the number in the centers' records. Officials at two of these centers 
suggested that some clients may have been assigned two numbers, thus 
overstating the data base total. (Two files in our sample, though not 
from these centers, v/ere for clients assigned more than one number.) 

At the remaining nine centers, the number of clients in the data base 
was less than the number in the centers' records. Although a portion of 
this discrepancy is most likely due to a lag in entering code sheets into 
the data base, officials also suggested that some code sheets may never 
have been forwarded to the data processing center; others may have 
been rejected by the computer program and never reentered. 

In the 100 sample files we reviewed, we found a total of 1,353 contact 
sheets compared with 1,300 in the data base. Although the overall dis- 
crepancy was small, 15 of the files had a lesser number of contacts than 
did the data base, and 23 files had a greater number. The discrepancies 
ranged from 1 to 76, with about three-quarters of them being 5 or less. 
Since we did not count contacts in the file that occurred after the date of 
the last contact in the data base, the time lag in entering contact sheets 
into the data base should not have accounted for a significant part of 
the discrepancy. Because of errors in assigning client numbers, we were 
told Aat the data base overstated the number of contacts two clients in 
our sample made. Some the contacts attributed to these clients in the 
data base were actually made by clients outside our sample. 



Computerized Data 
Base Discontinued 



In August 1984, the Readjustment Counseling Program officials revised 
both the code and contact sheets to collect more detailed demographic 
and clinical information about clients and workload statistics about vet 
center staff. According to the program director, the more detailed data 



! For three centers, we increased the data base count to allow us to compare those numbers with the 
vet center records at the same point in time. 



Page 38 



40 



GAO/HRD-87-63 Vet Counseling Centers 



Chapter 4 

Accuracy of Readjustment Counseling 
Program Data Base Questionable 



base was to be used as a clinical, management, and research tool. Vet 
center staff began using the new data collection forms in October 1984. 

However, throughout fiscal year 1985, Readjustment Counseling Pro- 
gram officials faced numerous delays in making the new system opera- 
tional beca- se of computer design and progi ^mming problems, as well 
as user confusion over how to complete the new forms. In early 1985, 
these problems caused the data processing center to return for correc- 
tions about 28 percent of the forms it received. According to Readjust- 
ment Counseling Program statistics, over 11 percent of client code 
sheets were never entered into the data base. Moreover, region VI offi- 
cials told us that in an effort to re 'uce the number of forms returned f>n 
correction, counselors would either not code all clients' problems on con- 
tact sheets or would code the problem information exactly as it had been 
done on the previous sheet. 

The Readjustment Counseling Program officials told us they took sev- 
eral steps to try to resolve their problems, including requiring that (1) 
regional offices instruct center staff on how to complete the code and 
contact shev ts, (2) regional officials in early fiscal year 1986 only visit 
centers with the most difficulty completing their forms, (3) each center 
designate a staff member to assure that forms were properly coded, (4) 
centers with dif<"oultie& seek assistance from staff at centers with few 
problems, and (5; programming changes be considered. 

The Readjustment Counseling Program director said that despite these 
efforts, the new data collection system was still too complex and con- 
sumed «-oo much of counselors' time. In January 1986, the system was 
discoi.t.nued. As was the case during fiscal year 1985, the on!/ statisti- 
cal information regional and central office progran. onagers received 
about vet center clients, after the system was discontinued, was a t ,eri- 
odic report of new clients seen and client visits made, which were * 
counted by a manual system. 

In place of the computerized data base, a manual system for data collec- 
tion was estaolished. This system was implemented on October 1, 1986, 
and cilected what the director considered to be minimum program data 
needs: the number of new clients seen; whether clients had served dur- 
ing the Vietnam era; the number of client visit made; and staff time 
spent (1) counseling clients face-to-face inside and outside vet centers, 
(2) counseling clients on the telephone, (3) traveling to counsel clients, 
and (4) consulting with, educating, or developing community resources 
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or other services for veterans. The system collected no demographic or 
clinical data about clients except their problems. 



PnnrliiQirmQ ^° determine the continued need for centers in particular locations, the 

Readjustment Counseling Service needs an accurate count of clients who 
come to vet centers and the number of times those clients receive coun- 
seling. However, the data collected since program inception will be of 
little use to va for making decisions about the need for specific centers 
because (1) reportable clients and client contacts were not consistently 
defined or reported and (2) vet center records did not always agree with 
the data base statistics. 



The new data collection system should provide the Readjustment Coun- 
seling Service with the minimum data it needs to manage the program. 
In addition, the director's December 1986 . ctions — to clarify which cli- 
ent contacts should be reported — should also inciease the reliability of 
the data. Because of these recent actions, we are not making any 
i ecommendations. 



A26IICV Comments * n ^ une * * ' etter > ^ e Administrator said that the data system used 

& y from 1980 through 1984 was cumbersome, and the system promulgated 

in 1385 was even more so. He added that the system begun in fiscal year 
1987 is much more streamlined. 
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Most Vet Center Staffs Met VA Qualifications 



Both our questionnaire and site visits indicated that the vet centers 
were operated by an adequate complement of professional staffs whose 
qualifications generally met those specified by the Readjustment Coun- 
seling Service Program Guide (issued in 1982); that is, staff members 
were Vietnam era veterans with the appropriate academic degrees and 
work experience. Moreover, we found that many of the centers were 
able to augment their professional staffs wit»~ volunteers, students (who 
were veterans) in work-study programs, and graduate students. 

However, responses to our questionnaire indicated that about 25 to 50 
percent of the team leaders and satellite coordinators hired since Octo- 
ber 1, 1984, had not received the training they were supposed to have 
concerning many areas, for example, the adjustment problems of Viet- 
nam veterans. 



V?t Centers Were 
Staffed in Accordance 
With Program Guide 



The Readjustment Counseling Service Program Guide states that vet 
centers are to be staffed by four-member or five-member teams (each 
with a team leader), two or three counselors, and a clerical staff mem- 
ber. (According to the director, qualified clerical staff may have counsel- 
ing responsibilities.) The Guide also states that satellite centers 
(discussed in ch. 1) are to be staffed by one to three people. According to 
the program director, satellite center staff usually are all counselors, 
including the satellite coordinator. The centers are also encouraged to 
use volunteers, work-study students, and graduate interns to augment 
and balance their email permanent staffs. 

As of early January 1986, vet centers were generally staffed in accord- 
ance with the Guide, as shown in figures 5.1 and 5.2. 

Staff composition as of early January 1986, at the 12 centers we visited, 
was generally consistent with the Program Guide. According to the pro- 
gram director, deviations from the Guide are slmost always due to 
unusually high or low client activity. 

Vet centers were also able to supplement their staffs, primarily with 
clerical volunteers or work-study stud', its, as illustrated in figure 5.3. 

All 12 vet centers we visited had at least one clerical volunteer or work- 
study student on the staff at some time between January and May 1983; 
three center^ ' ad volunteer counselors or professionals. For example, a 
part-time vo.unteer at the Boston Vet Center was an attorney who pro- 
vided discharge upgrade assistance. Additionally, three centers used 
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Figure 5.1: Staff Composition at Vet ■^■■il^H^H 

Centers (Jan 1986) 

1 20 Pcrcont of V«t Centers With Staff 



100 




other types of volunteers, including one who nelped write a center 
newsletter and another who provided academic tutoring to clients. 

Three of the centers we visited had graduate student interns on their 
staffs in early January 1986, and a fourth center had one at the time of 
our visit in May 1986. Other centers did not use interns for these rea- 
sons: (1) they were not available or willing to work at the center, and (2) 
the center had no funds for them or no time or staff to adequately 
supervise them. 

In addition to VA-salaried and volunteer staff, vet centers also had others 
on hand to provide services to clients in fiscal year 1985. According to 
the questionnaire results, 79 percent of centers that opened before Octo- 
ber 1, 1984, had a Disabled Veterans' Outreach Program specialist 1 pro- 
vide employment services to veterans. About half of the centers that 



■The Disabled Veterans' Outreach Program, established by the Veterans* Rehabilitation and Educa- 
tion Amendments of 1980 (Public Law 96-46CJ, was designed to m'ot the employment needs of veter- 
ans, particularly disabled Vietnam era veterans, by providing funds to states to, among other things, 
develop job and job-training opportunities forther.i. 
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Figure 5.2: Staff Composition at Satellite ■■■^HB^Hi^H^B 

Centers (Jan 1986) 

1 20 Ptrctnt of Satellite Centers With Staff 



100 




opened before October 1, 1984, also used other va and veterans' organi- 
zation staffs to provick services. At the St. Petersburg Vet Center, for 
example, the team leader told us that the ptsd unit coordinator and a 
psychiatric nurse from the support facility led a group for clients' wives 
and girlfriends and provided family counseling. The Bangor Vet Center 
team leader told us a staff psychologist from the support facility came 
there 3 days a month to evaluate clients. At five centers we visited, rep- 
resentatives from veterans' organizations provided clients assistance, 
such as helping them process theix ui&abii ; iy ciaims. 



A Readjustment Counseling Program circular provides examples of aca- 
demic background and work experience considered relevant to center 
counseling functions (including possession of a clinically oriented degree 
in a field such as psychology, social work, or counseling and experience 
in readjustment, crisis and emergency, or community-based counseling). 
The circular also notes that experience in management, supervision, and 
media relations is relevant for team leaders and suggests that team lead- 
ers and counselors be Vietnam theater, or at least Vietnam era, veterans. 



Most Vet Center Staffs 
Had Relevant 
Experience 



Q 
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Figure 5.3: Availability of Supplementary ■■■■■■■■■■^■■■■■■■■■■■■■1 

Staff at Vet Centers 8 (Jan. 1986) 

100 Percent of Vet Centers That Employ Supplementary Staff 



80 



60 




■For vet centers that opened before fiscal year 1975. 

Most vet center staff met the program's academic background expecta- 
tions, as indicated in figures 5.4. and 5.5. 

Team leaders at the centers we visited had comparable academic 
degrees, but proportionally fewer counselors had studied in a profes- 
sionally related field. 

Team leaders reported in the questionnaire that half of them had over 8 
years of professional experience in counseling, mental health, social 
work, or other social service employment; 85 percent of them had over 4 
years of experience. Seventy-seven percent of satellite coordinators and 
60 percent of the counselors had more than 4 years of such experience. 
This was generally comparable with the experience the staffs at the cen- 
ters we visited told us that they had. The team leader at the Jackson Vet 
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Figure 5.4: Highest Academic Degree H^HHHH 
Earned by Team Leaders, Satellite 

Coordinators, and Counselors (1986) 80 p «'c« nt °* staff 




Team leaders 
[ | Satellite Coordinators 
I Counselors 



Center, for example, had a background as director of a community alco- 
hol and drug treatment program, supervisor in a state vocational reha- 
bilitation office, and teacher of various subjects relating to human 
relations and substance abuse. At least two-thirds of the team leaders 
we talked with also had prior experience in supervision and media 
relations. 

Foi the most part, vet center staffs were Vietnam era veterans, as 
shown in figure 5.6. 
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Figure 5.5; Primary Academic Field of 
Study of Team Leaders, Satellite 
Coordinators, and Counselors (1986) 




Satellite Coordinators 



Counselors 



Most Vet Center Staffs 
Included a Recognized VA 
Mental Health Professional 



The original program legislation authorized ya to use paraprofessionals 
on the vet center staffs. In explaining tms provision, the Senate Commit- 
tee on Veterans' Affairs stated that much of the initial intake and 
screening could be most effectively provided by trained paraprofession- 
als; as they gained experience, these parapro "essionals would become 
sensitive to the readjustment needs and proLiems of veterans. The 
report further stated that the vast majority of cases should not require 
extensive use of highly trained psychiatric and psychological personnel. 
However, in May 1984, the Senate Committee noted that there appeared 
to be a need for additional mental health professionals in the vet cen- 
ters. The Committee was concerned that the veterans needed more 
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F'surd 5 6: Veteran Status of Team 
Leaders, Satellite Coordinators, and 
Counselors (1986) 




Satellite Coordinators 



| | Counselors 

extensive mental health services than the "relatively brief and 
superficial supportive counseling, with referrals for more definitive 
treatment," that were being provided. 

To improve the quality of care, the Readjustment Counseling Service 
director established a policy in 1982, he told us, requiring ev.ch center to 
have a qualified mental he<~. \ professional. A qualified mental health 
professional is defined by the service as any one of the following: 

» a psychiatrist who has completed 3 years of psychiatric residency, 

• a clinical or counseling psychologist with a doctorate who has attended 
an American Psycholo^*l Association-approved school and completed 
an association-approved internship, 

• a social worker who has a master's degree in social work from a school 
accredited by the Council on Social Work Education, or 
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• a psychiatric nurse clinical specialist who has a master of arts in psychi- 
atric nursing with associated training. 

The director said that one mental health professional was included in 
the hiring plan of each new center; the position was being added at 
existing centers as other staff left the progn*. x As of March 1987, 84 
percent of the centers nationwide included a mental health professional 
for each center. 



Many Staff Were in Their Tv/enty-four percent of team leaders, 55 percent of satellite coordina- 
Positions Less Than 1 Year tors> an( * ^3 percent of counselors at centers that opened before October 

1, 1984, had been in their positions less than 1 year at the time the ques- 
tionnaire was completed. Moreover, during fiscal year 1985, according 
to the regions* quarterly reports submitted to va's central office, 29 of 
these centers had a team leader vacancy; 57 centers had one or more 
counselor vacancies. The program director stated that many staff mem- 
bers had transferred to the new centers opened that year. He also noted 
that some staff members left the program because their jobs were emo- 
tional and stressful. They had used the centers as stepping-stones in 
their careers and knew the program' 0 , authorization would be expiring. 

Staff turnover also occurred in the regional offices and the central office 
in fiscal year 1985. At the regions we visited, one of three regional man- 
agers, two of four associate regional managers for counseling, and one of 
three associate regional managers for administration left their positions 
during this time. At the central office, the assistant director for counsel- 
ing and the assistant director for administration left the program. 



Regional Offices 
Provided Most of the 
Required Training to 
Vet Center Staffs 



In their management objectives for fiscal year 1985, regional staffs were 
required to provide two training sessions — one for team leaders and one 
for team leaders together with other vet center staffs. 2 The management 
objectives did not specify the content of the sessions. The director stated 
that he saw no need to prescribe course content because, since the pro- 
gram's inception, courses were continually being developed. He told us 
that the central office monitored the provision of training by reviewing 
the f fining agendas. 



The three regions we visited conducted the required training in fiscal 
year 1985. Sessions for team leaders covered issues such as fiscal and 

2 Region II training was required only for team leaders 
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personnel matters and clinical recordkeeping. The sessions for all staff 
members included counseling for special populations, domestic violence, 
and substance abuse; clinical writing; treating ptsd; and psychotherapy 
methods. All regions visited developed their training agendas based on a 
needs assessment. Region I officials told us, for example, they formed 
curriculum committees prior to each course to help develop the agei^a. 

Most vet center staffs received training in fiscal year 1985 in the areas 
listed in table 5.1. Usually, this training was provided by the program's 
regional staff. 



Table 5.1 : Training Provided to Vet ^^^H^^^^^HM^^^^M^^^^^h^^^^^^^^^^^^^^^^^^^^ 

Center Staffs 8 (Fiscal Yea' 1 985) 

Percent of 
vet centers 



receiving 
training 

95 



PTSD treatment 


95 


Individual counseling techniques 


92 


Group counseling techniques 


91 


Administration/management techniques 


90 


Stress reduction management 


89 


Treatment of substance abusers 


88 


Family counseling techniques 


86 


Treatment of clinical disorders 


86 


Marriage counseling techniques 


78 



a For vet centers that opened before October 1. 1984 



Not All New Team Leaders To introduce new staff (particularly those hired at the 52 centers that 



and Satellite Coordinators 
Received Orientation 
Training 



opened beginning in fiscal year 1985) to the Readjustment Counseling 
Program, the regional offices were required to develop special orienta- 
tion sessions. However, about one-quarter to one-half of the team lead- 
ers and satellite coordinators hired since October 1, 1984, reported that 
they did not receive training in many areas. The director considered all 
the areas listed in table 5.2 to be valid ones for orientation training. 
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Table 5,2: Orientation Training Given to 




Team Leaders and Satellite Coordinators Percent receiving training 

(Fiscal Year I985) a Team Satellite 



A rea lea ders coordinators 



Vietnam veterans' adjustment problems 


72 


68 


Diagnosis and treatment of PTSD 


68 


58 


Administrative/fiscal requirements 


64 


63 


VA administrative nnd support services 


64 


74 


Clinical recordkeeping 


64 


63 


Needs of special groups (e g„ minority and disabled) 


63 


63 


Vet center outreach techniques 


63 


53 


Crisis intervention 


61 


63 


Individual and group counseling techniques 


60 


63 


Community relations 


55 


37 


Working with media 


48 


42 


History of Vietnam and Vietnam war 


48 


63 


Staff development 


44 


42 


VA benefits and discharge upgrade process 


41 


63 



including only team leaders and satellite coordinators that were hired after October 1, 1984 



The director could not explain why many new team leaders and satellite 
coordinators reported that they did not receive orientation training. He 
noted that training held jointly by regions V and VI was not well organ- 
ized. Thirteen of the 22 team leaders and satellite coordinators who 
reported they received no training were from these two regions. The 
director said he intended to further investigate attendance at orientation 
training. 

According to regions III and VI officials, to help orient staffs at newly 
established centers, these officials paired new staff members with staff 
members at a nearby established center. For example, in region VI the 
new center staff spent time at their assigned center for on-the-job train- 
ing and then were encouraged to rely on that center to answer questions 
as they arose. 



PnnHiiQinnQ Vet center staffs 8 enerall y had the qualifications intended by the pro- 

UOnClUSlOrlS g ram g u i(j ance However, a^out one-quarter to one-half of new team 

leaders and satellite coordinators reported that they had not received 
orientation training in many relevant areas. Program expansion is now 
complete, but staff turnover makes continued training of new °taff nec- 
essary. If the director monitors the provision of orientation training, as 
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he indicated he would, this should assure that new staff are introduced 
to program requirements and issues. 



Agency Comments In his Time 1 1 letter ' the Administrator said that va believed that in 

responding to our questionnaire, recently hired team leaders and satel- 
lite coordinators under-reported the training they received. Nonetheless, 
he stated that our findings were "cause for concern." He added that 
regional management staff have been instructed to assure that newly 
hired staff Ui^vrmly obtain training in the areas specified in table 5.2. 
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The Readjustment Counseling Service Program Guide, issued in 1982, 
states that each vet center should develop a systematic outreach pro- 
gram, a program of readjustment counseling services, and an appropri- 
ate community-based referral network. Each center should also conduct 
timely follow-up to counseling and referral services provided. For out- 
reach, the vet centers used a variety of techniques to identify and locate 
Vietnam veterans who could benefit from the program, and offered an 
array of services to them. The centers also had well-established referral 
networks. However, officials at nine of the centers acknowledged that 
their follow-up of clients was often not done or was dependent on the 
judgment of individual counselors. 



Ccnt6 * US6d Si According to the Readjustment Counseling Service Program Guide, out- 

• ° e r\ u reach is an essential aspect of vet center functions. The Guide defines 

V3T16ty 01 UUtrG3.Cn outreach as any activity by which vet centers locate identify , or other- 
TGChniQUGS w * se come i nt0 contact with Vietnam veterans who may need readjust- 

ment counseling services. 



According to the questionnaire responses, the most popular outreach 
techniques were developing relations with other service agencies and 
sponsoring community education programs. Officials from all the cen- 
ters we visited told us that they conducted outreach by dev°Dping rela- 
tions with other service agen ; es; officials from 11 centers told us that 
they sponsored community education programs. The Bangor Vet Center, 
for example, made quarterly presentations to a regional council on alco- 
hol and drug abuse in order to educate and inform the council about the 
vet center and veterans* readjustment problems. The St. Petersburg Vet 
Center held an open house for veterans and local community and va 
officials. 



Forty-two percent of the centers nationwide reported in the question- 
naire that they frequently used television, newspapers, and other media 
as an outreach technique. All but one center we visited used this tech- 
nique. For example, the Las Vegas Vet Center team leader said that he 
had a local television station flash the center's name and phone number 
v n the screen periodically during programs on Vietnam. Knoxville Vet 
Center team members participated in radio and television talk and news 
shows on veterans and vet center activities. 



Less frequently used outreach techniques, according to the question- 
naire responses, were direct mailings, pamphlets or newsletters, notices 
in public places, and special advertising items. With the exception of 
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special advertising items, less than half the centers we visited used 
these outreach techniques. For example, only four centers periodically 
published a newsletter. The Oakland Vet Center team leader said that 
direct mailings were not effective because many veterans in that area 
were homeless or transient, and would not be reached. Although not 
popular nationwide, six centers visited used special advertising items, 
such as bumper stickers, to advertise their services. 

In addition to the outreach techniques mentioned in responses to the 
questionnaire, some centers we visited used other techniques. For exam- 
ple, the Sreenville (?outh Carolina) Vet Center clients, wearing hats 
with the vet center name on them, parked cars and greeted people 
attending a local festival. The Bangor Vet C" nter periodically set up a 
boot* at a shopping mall; the team leader stated that this was an effec- 
tive way to reach prospective clients. 



Vogram guidance states that vet centers should provide individual and 
group counseling and a program involving family members and signifi- 
cant others in counseling. The Readjustment Counseling Service director 
stated that all centers should also provide these services: a 24-hour tele- 
phone service so that center staff can be available to clients in need at 
any time, group counseling specifically for minorities and women if the 
population is sufficient to justify it, and employment and vocational 
assistance because chronic unemployment is a symptom of readjust- 
ment problems. 

Most centers offered a wide array of services, as shown in table 6.1. 



Centers Offered an 
Array of Services 
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Table 6.1 : Services Offered by Vet ■■■^■HH^H^H^B^HHI 

Centers" (Jan. 1986) Percent of 

centers 
offering 

Service service 



Individual counseling for veterans 


100 


Individual counseling for veterans' spouses/significant others 


99 


Group counseling for veterans 


99 


Family counseling 


98 


Ma;riage counseling 


98 


Employment/vocational assistance 


92 


Substance abuse counseling 


91 


^roup counseling for veterans' spo ises/ significant others 


86 


Individual counseling for children of veterans 


81 


VA benefits assistance 


81 


Genera! welfare assistance 


72 


Counseling or services specifically for minorities 


71 


Counseling or services specifically for women 


67 


Discharge upgrade assistance 


62 


24-hour telephone crisis intervention/ telephone-answering service 


61 



a For vet centers that opened before Octooer 1, 1984, 



Services provided by the centers we visited were generally consistent 
with the questionnaire responses, except that proportionally fewer cen- 
ters (the percentage of centers we visited compared with the percentage 
of the total centers responding to the questionnaire) provided group 
counseling for spouses and significant others, services specifically for 
minorities and women, and discharge upgrade assistance. Vet center 
staffs told us that, generally, the services clients used most frequently 
were individual and group counseling for veterans and employment 
assistance. Staff members gave a variety of reasons why other services 
were not used as frequently, for example: 

• A Sail Jose Vet Center counselor noted that family counseling was not 
popular because many veterans in that area had no family, and others 
were reluctant to involve their families in their therapy. 

• Officials at seven centers said cnildren were not counseled frequently 
because the teams lacked expertise or time, relied on referral agencies, 
or simply did not see enough children needing counseling. 

• The Las Vegas Vet Center team leader stated that his center had no 
interest in a spouse or significant other counseling O roup because partic- 
ipation in previous groups was low. 
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• Officials at three vet centers told us that they usually referred clients 
needing general welfare assistance to other agencies. 



Group Activities at Vet The 12 centers we visited offered an average of four counseling groups. 

Centers Visited The number ranged from one at the Jackson and Las Vegas Vet Centers 

to eight at the Albuqueraue Vet Center. At 10 of these centers we 
observed a total of 14 groups, as shown in table 6.2. 



Table 6.2: Counseling Groups Observed 



Type of group 


Number of 
groups 
observed 


Average 

number of 
participants 


General counseling for veterans 


9 


7 


Counseling for spouses and significant others 


2 


6 


Alcohol awareness 


2 


11 


Anger management 


1 


6 



No group sessions were held at the remaining two centers during our 
visit. 



In addition to groups held at vet centers, we were told that staff at the 
Albuquerque Vet Center conducted sessions for psychiatric patients at 
its support facility, and staff at the St. Petersburg Vet Center, sessions 
for ptsd patients at its support facility . Additionally, the Pawtucket 
(Rhode Island) Vet Center staff conducted a group for veterans at a 
community mental health clinic. 

Eight centers also conducted group activities such as softball games, 
parties, and field trips. The Greenville Vet Center, for example, orga- 
nized a weekend camping trip for clients and their families. A counselor 
at the Albuquerque Vet Center told us that someone from the support 
facility led a poetry group for vet center clients. Staff at several vet 
centers told us that they considered these activities therapeutic and 
helpful to clients in developing their social skills. 



Not All Services Were The primary mission of the Readjustment Counseling Program is to pro- 

Provided in a Counseling v '^ e needed readjustment counseling. In a description of the services vet 
Context center staf f are expected to provide, the Readjustment Counseling Ser- 

vic? director stated that technical assistance— (1) helping veterans pre- 
pare benefits claims, find a job, or upgrade their militarv discharge or 
(2) testing veterans for educational level or vocational skills— was not 
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appropriate unless such assistance was incidental to the general counsel- 
ing process. If the technical assistance needed was an integral part of 
the veteran's readjustment process, the director stated, and if the coun- 
selor had the appropriate technical skills, this assistance could properly 
be provided and could be very helpful. This position was arrived at by 
va based on congressional hearings, committee reports, and prior experi- 
ence by mental health professionals and community-based Vietnam vet- 
eran service organizations in the private sector. 

*As noted earlier, the questionnaire responses indicated that the majority 
of vet centers offered technical assistance. Our review of 100 clinical 
files suggested, however, that such assistance was not alv/ays provided 
in a general counseling context. In 16 percent of the cases we reviewed, 
vet center staff members provided or referred clients for employment 
and other technical assistance, without documenting that general read- 
justment counseling was provided, for example: 

• A Granville Vet Center staff member assisted a client who wished to 
reenter the armed services and needed a copy of his military records. No 
counseling was documented nor was an assessment of the client's back- 
ground, military experience, or present situation provided in the prog- 
ress notes. 

• The Pawtucket Vet Center assisted four clients with employment, voca- 
tional training, benefits, and a request for records without documenting, 
in progress notes, that an assessment was made or readjustment coun- 
seling was provided. In three of these cases the client was referred to a 
local veterans' organization. 

• A counselor at the Albuquerque Vet Center assessed a client interested 
in benefits information as functioning well with a positive family rela- 
tionship and no major problems. The counselor scheduled the client for a 
va medical examination, but did not document in progress notes that 
counseling occurred. 

The va Health Care Amendments of 1985 (Public Law 99-166, Dec. 3, 
1985) require va to establish a pilot program under which designated vet 
centers provide Vietnam veterans with additional services, including 
assistance in applying foi va benefits and obtaining jobs. According to 
the Readjustment Counseling Service director, as of December 1986, two 
centers were operating under the pilot program. He said technical assis- 
tance without readjustment counseling may properly be provided at 
these centers. 
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Program guidance notes that the ability to make appropriate referrals is 
critical to the quality and effectiveness of readjustment counseling. It 
suggests that vet centers develop an appropriate community-based 
referral network, including va sources and other organizations dealing 
with employment, incarcerated veterans, discharge ungrades, and gen- 
eral welfare. We found that the centers 7 referral netv :>rks were well 
established and widely used. 

Vet Centers Were Aware of Nearly all vet centers were aware of a wide variety of services available 
Community Services for referral in their local areas, as shown in table 6.3. 

Available for Client 
Referrals 

Table 6.3: Services Available to Vet HHMMHHMH 

Centers Through Referrals to Other 
Programs (Fiscal Year 1985) 

Service 

Substance abuse a ssistance 
VA benefits assistance 



Psychiatric treatment 



General welfare assistance 


98 


Employment/vocational assistance 


97 


Medical assistance 


96 


Educational assistance 


96 


Domestic abuse assistance 


92 


Psychological evaluation 


92 


Discharge upgrade assistarce 


JO 


Legal assistance 


80 



Nearly all centers with these services available in their communities 
referred clients to the organizations providing them m fiscal year 1985. 

va facilities (other than vet centers) were most frequently identified as 
referral targets for clients' va benefits and substance abuse, as well as 
psychological, psychiatric, medical, and educational assistance ne*ds. 
Social service agencies were most frequently identified as referral 
targets for clients' general welfare < \ domestic abuse assistance needs; 
legal aid agencies were most frequently identified as providing legal 



Centers' Referral 
Networks Well 
Established 



Percent of 
vet centers 
aware of 
referral 
service 



98 



98 
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assistance; employment agencies were most frequently identified as pro- 
viding employment assistance. Veterans' organizations were most fre- 
quently identified as providing discharge upgrade assistance. 

The vet centers we visited also had extensive referral networks. Team 
leaders noted, however, needs that could not be met through the centers' 
existing networks. The most frequently mentioned were services for 
homeless and transient veterans. Team leaders from six vet centers indi- 
cated that in their areas, there were few shelters to handle these veter- 
ans, especially on a long-term basis. Other unmet needs team leaders 
noted included employment, training, and medical health care for veter- 
ans with nonservice-connected disabilities. 

We called from six to nine community agencies in the local areas served 
by each vet center visited; some agencies were identified for us by vet 
center staff, and we randomly selected others from telephone books. 
The randomly selected agencies routinely served Vietnam era veterans 
or their families. Of the total 89 agencies called, 83 percent said that 
they were familiar with vet center activities. More than half (53 per- 
cent) said that they had received referrals from a vet center in the past 
6 months; all these agencies said that they believed they were able to 
assist the veterans referred. 



According to the questionnaire, nearly all centers received referrals in 
fiscal year 1985 from veteran service organizations, other va facilities, 
employment services, mental health providers, substance abuse pro- 
grams, social serv ; - j agencies, and the judicial systems. The team lead- 
ers we interviewed generally regarded their centers as ab 1 ? to provide 
relevant services to those referred; according to the team leaders, they 
received few inappropriate referrals. 

Sixty-three percent of the community agencies we called had referred an 
individual to a center at least once in the previous 6 months. No agency 
expressed dissatisfaction with the services the vet centers provided. 
Several complimented vet center staffs for their devotion and assistance 
to needy veterans. 

Most vet centers we visited were attempting co further develop their 
referral networks. Team leaders at six centers told us that they or their 
staff had participated in forum activities at local mental health or social 
service agencies; five team leaders told us that they had mailed informa- 
tional letters to heads of community agencies. 



Vet Centers Received 
Referrals From a Variety 
of Community Agencies 
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Follow Up Not 
Emphasized 



A 1981 review of the Readjustment Counseling Program, conducted by 
va's Office of Program Planning and Evaluation, recommended that vet 
center staff closely monitor the status and progress of all clients, includ- 
ing those referred elsewhere. The review noted that although most cen- 
ters followed up in some way on clients served directly by the team, the 
process was rarely systematic and continuous; many cei.^rs depended 
on individual counselors to determine when and if follow-up should be 
done. The review concluded that such an approach could lead to a high 
degree of variability in the methods, frequency, and intensity of the fol- 
low-up. The office indicated that follow-up was important because it 
was an expression of commitment and concern and because it would 
involve an "assessment of the effectiveness and expediency of service 
provided" by the vet center team. 

Tn December 1981, a dm&S circular required vet centers to follow up on 
at least 50 percent of their clients within 90 days of their last visit. Fur- 
ther, the IP i2 Program Guide states that as a counseling objective, vet 
center stati should establish a system for conducting timely follow-up. 
Since December 1984, the standard protocols used by Readjustment 
Counseling Service regional officials when making clinical site visits to 
their vet centers required them to assess follow-up procedures. 

Since other va programs, such as mental health clinics, do not require 
follow-up, according to the Readjustment Counseling Service director, it 
should net be required for vet centers; compliance with the 50-percent 
follow-up requirement was never enforced and was no longer valid. Fol- 
low-up is important, he said, and should be done, but should not take 
priority over providing services to current clients. 

Regional officials' opinions concerning the importance of follow-up were 
not consistent. In June 1985, the region VI assistant regional manager 
for counseling instructed that region's team leaders that follow-up was a 
clinical exercise, not an administrative task; it was to be conducted by 
counselors and all cases must either be closed or the client contacted, 
preferably as early as 1 month after the client's last visit. Similarly, ' 
region III officials told us that they expected vet center counselors to 
either follow up on all clients involved in treatment or, possibly, close 
out cases of clients seen only once for noncounseling assistance. The 
region I assistant regional manager f >r counseling, however, told us that 
centers in that region were "encouraged," but not required, to follow up 
on clients. 
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Officials at nine centers visited said that their follow-up efforts were 
often not done or were dependent on the judgment of individual counsel- 
ors, for example: 

• Although their clerical staff daily identified clients not seen within the 
previous 30 days, the Las Vegas Vet Center team leader told us, counsel- 
ors would usually not follow up on these clients. He said follow-up 
efforts were not made because the clients did not need further assis- 
tance or they were homeless or transient and not reachable. 

• Follow-up was a low priority, the Greenville and Springfield Vet Center 
team leaders told us, because of other demands on staff time. The 
Greenville Vet Center team leader added that the center's newsletter 
was mailed to clients and served as a follow-up mechanism. 

• Bangor Vet Center officials told us that they relied on work-study stu- 
dents tc help conduct follow-up. But since the center had no students for 
about 6 months in 1985, follow-up was not done. 

• Team leaders from the Oakland, St. Petersburg, Knoxville, and Boston 
Vet Centers relied on individual counselors' deciding if follow-up would 
be done. Only about 20 percent of clients not seen in the previous 90 
days were followed up, according to the Oakland Vet Center team 
leader, because counselors believed those clients needed no further 
a^istance, were being helped elsewhere, or were homeless or transient 
and not reachable. 



Our Observations of 
Vet Center Activity 



Our daylong, unannounced visits to six vet centers generally occurred 
from 8:30 a.m. to 5:30 p.m; we did not stay for evening activities. We 
observed the following about client activity- 

Between 5 and 17 clients came to each center; the average was 9. 
Client visits lasted from 1 minute to over 4 1/2 hours, with the average 
being about 1 hour. 

On average, clients spent 70 percent of their time with a counselor or 
other staff member and 30 percent of their time on other activities, such 
as casual interactions with the staff, reading, using recreational equip- 
ment, or walking around the center. Staffs at the vet centers docu- 
mented 83 nonpersonal telephone calls dur ig our visits. Fifty-uve 
percent of the calls were from Vietnam era veterans, almost half of 
whom called to schedule an appointment; counseling was provided for 
15 percent of the calls. The staff spent an average of 9 minutes on each 
telephone call. 
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The number of team leaders and counselors present during our visits 
ranged from one to four. Office managers were present at all but one 
center; that center, however, had a volunteer clerical staff member pre- 
sent. Dis ;bled Veterans Outreach Program specialists were present at 
two centers. Team leaders were at the vet centers an average of 8 hours 
and 15 minutes, and counselors were at the centers an average of nearly 
5 hours and 45 minutes. They spent their time as shown in figure 6.1. 



Figure 6.1: Team Leader and Counselor 
Activities Observed by QAO During 
Unannounced Site Visits (1986)* 



70 Percent of Time 




6- 
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J Team Leaders 
Counselors 



a A team leader was not present at one of the six vet centers we visited Thus, the statistics on team 
leaders are based on ot iors o« only fn e leaders The time spent by individual team leaders and 
counselors on each of thei><; °s varied widsly 
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The results of our questionnaire, shown in figure 6.2, indicate that vet 
center staff spent more time counseling clients than our observations 
indicated. 



Figure 6.2: Tasks Performed by Team 
Leaders and Counselors (1986) 
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Team leaders reported in the questionnaire that they spent 24 percent of 
their time away from the vet centers; counselors spent about 19 percent 
of their time away. Staff members at some of the centers visited told us 
that this time was spent on activities such as developing relations with 
other agencies, making presentations, visiting veterans at local jails or 
their koines, taking training, and attending meetings at support 
facilities. 
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Conclusions Vet " enters ' outreach, service provision, and referral systems were con- 

duced as specified in the Program Guide. In addition, some centers vis- 
ited devised their own techniques for reaching and servir ? clients, 
although not all services were provided in a counseling co ^text. The cen- 
ters visited appeared to be well known by community agencies in their 
areas. 

Follow-up of clients was not always conducted. The Readjustment Coun- 
seling Service director said, however, that it need not be a high priority. 
If va believes follow-up is not important, program guidance should be 
changed tc reflect this. If va does consider follow-up important, it should 
better enforce the current requirement. 



We recommend that the Administrator direct the chief medical director 
to (1) clarify the importance of client follow-up, anci (2) if follow-up is 
considered important, monitor regional officials' site visit reports to 
determine whether follow-up has been adequately conducted. 



Recommendations to 
the Administrator of 
Veterans Affairs 



Agency Comments In hls June 1 1 letter ' the Administrator concurred and stated that by the 

end of fiscal year 1987, va plans to distribute revised guidance concern- 
ing follow-up requirements. By the same target date, regional manage- 
ment officials' site visit reports will reflect an assessment and 
evaluation of follow-up activities. 
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Vet centers are required to maintain administrative relations with their 
support facilities and collaborate with them in such professional areas 
as clinical and training matters. We found that there was satisi^ctory 
collaboration on administrative and clinical matters; however, for 
clinical matters and training activities between vet centers and distant 
support facilities, there was not full collaboration. 

In addition, vet centers were not using the specialized ptsd inpatient 
units in va hospitals, although the Veterans 1 Health Care Act of 1984 
requires that these units coordinate their services with the ReacUust- 
ment Counseling Program. According to responses to our questionnaire, 
75 percent of the clients identified by vet centers as needing inpatient 
treatment for PTSD were no 4 ; referred to a designated unit. Moreover, 
once a center referred a client to a unit, there was limited contact 
between the two facilities. 



A dm&s program circular and other program guidance state that each vet 
center and its support facility should maintain administrative relations 
and collaborate on clinical matters and training. We found, from our vis- 
its to 12 centers and the responses to our questionnaire, that the centers 
were doing this, except, generally, for those centers located 80 or mere 
miles from their support facilities. 

Vet center team leaders and support faciiity liaison officers coordinate 
this relationship. Most of the liaison officers at the support facilities vis- 
ited were either chiefs of Psychology or chiefs of Social Work. At two 
facilities, the liaison officer was an assistant to the medical center direc- 
tor. Generally, liaison officers viewed their responsibilities as assuring 
that relations between their vet centers and support facilities ran 
smoothly. In most cases, liaison officers did not expect the vet center 
staffs to deal directly with them concerning specific issues. 



All vet centers that opened before October 1, 1984, reported in the ques- 
tionnaire that in fiscal year 1985, they met with staff from their support 
facilities to disciL administrative matters. Officials from the centers 
and support facilities we visited also told us that they met with one 
another to discuss administrative matters, for example: 



Vet Center and 
Support Facility 
Relations Generally 
Satisfactory 



All Vet Centers 
Collaborated on 
Administrative Matters 
With Their Support 
Facilities 
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• Five team leaders told us that, in addition to other administrative con- 
tact with support facility staff, they participated in their support facil- 
ity director's monthly staff meetings. 

• The Springfield Vet Center team leader told us that the support facility 
liaison officer participated in that center's monthly staff meetings. 

• Officials from the Knoxville Vet Center's support facility said that t .ey 
met informally with center staff once a month. 

• The Bangor and San Jose Vet Centers' team leaders said that they met 
with support facility staff c nly as needed. 



Readjustment Counseling Service policy requires centers to have regular 
and systematic clinical collaboration, such as attending mental health 
clinic case conferences, with their support facilities. The director stated 
that collaboration was necessary to assure that program staff provided 
quality care. Many vet centers needed clin .<tl assistance, he said; since 
program regional staff could not conduct frequent site visits (see ch. 8), 
the best way to get assistance was through contact with support facility 
personnel. Similarly, support facility staff could learn more from vet 
centers about how to treat Vietnam veterans. 

The policy states that although weekly contact is desired, if distance is a 
problem, the contacts should be made as often as feasible (biweekly or 
monthly), The contacts must be substantive and, preferably, involve 
more than one member of the vet center staff. Finally, support facility 
staff involved should be mental health professionals with significant 
clinical responsibilities for treating Vietnam veterans or handling refer- 
rals between a vet center and support facility or both. The director told 
us that he expects the contacts to be face-to-face. 

In general, we found that, except at facilities 80 or more miles apart, vet 
center staff met with support facility staff to discuss clinical issues, as 
shown in figure 7.1. 

According to officials at 7 of the 12 vet centers and their support facili- 
ties, the officials spoke with one another about clinical matters at least 
once a week, for example: 

• The chief of psychology at the Albuquerque Vet Center's support facil- 
ity visited weekly, the team leader told us, to discuss specific clients 
with individual vet center counselors. 

• The support facility liaison officer for the Bangor Vet Center spent 1 
day a week, he told us, at that vet center, 76 miles away. 
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Figure 7.1: Effect of Distance Between 
Vet Centers and Support Facilities on 
Whether Clinical Collaboration Occurred 

(Fiscal Year 1985) 




0-20 21-40 41-60 61-80 Ovtr 80 

Distant MMIIesj 



— ■ - Individual Case Consultations 
^ Group Meetings 

a For vet centers that opened oefore fiscal year 1985 



• The support facility for the Oakland Vet Center had no clinical meetings 
with the center (35 miles away), according to the support facility liaison 
officer; however, a vet center staff memoer attended the nearby outpa- 
tient clinic's weekly staff meetings, a psychologist at the clinic told us, 
to discuss common matters. 

Team leaders at three other centers told us that their staffs also regu- 
larly met with their support facilities or their support facilities' outpa- 
tient clinic to discuss clinical matters, but the meetings were less than 
weekly. All three vet centers were within 30 miles of their support 
facilities. 

The remaining two centers (the Knoxville and Greenville Vet Centc s) 
had no regular clinical meetings with their support facilities, both of 
which were over 100 vr^es away. Moreover, neither center had regular 
meetings with the outpatient clinic in its city. According to the Knoxville 
Vet Center team leader, the vet center staff were considered the experts 
on counseling Vietnam veterans. The Greenville Vet Center team leader 
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consulted with the psychiatrist at the outpatient clinic in Greenville as 
needed, the leader said; the psychiatrist planned to come to the center 
weekly, beginning in October 1986, to provide clinical assistance. 



Vet Center and Support An associate deputy chief medical director's letter on professional col- 
Facility Staff Collaborate'' laborrtion, dated August 13, 1984, encouraged vet center and support 
On Training Activities facility staff to participate in each other's relevant professional continu- 

ing education and training activities. This would give them the opportu- 
: nity, according to che letter, exchange ideas and expertise and meet 

professional requirements; increase the understanding, diagnosis, and 
treatment of readjustment problems of Vietnam era veterans; and facili- 
tate the availability of staff for clinical consultation. 

The questionnaire responses indicated that, in fiscal year . 385, staff at 
about 75 percent of vet centers attended training at the support facility; 
staff at about 45 percent of the support facilities a. ended training at 
the vet centers Training, officials tok'. as, wao in areas «uch as ptsd, 
suicide, and treatment of substance abusers. As shown in figure 7.2, 
however, the percentage of vet centers' staffs attend'ng training at sup- 
port facilities dropped once the distance between the two reached 80 
miles; the percentage of support facility staff attending training at the 
vet cc ' rs dropped once the distance between the two reached 60 miles. 

Of the three centers we visited that were 60 or more miles from their 
support facilities, staffs at two of them (the KnoxviHe and Greenville 
Vet Centers) had not attended training at the support facilities, accord- 
ing to officials interviewed. Moreover, officials said that these two vet 
centers also did not have staffs attend relevant training given by the 
support facilities' outpatient clinics in the same city as the vet centers. 

Since 1982, no support facility staff from the facilities 60 or more miles 
from their vet centers, officials also said, had attended training giver> by 
the vet cente. j; however, the Knoxville Vet Center had provided train- ' 
ing to the outpatient clinic staff in it* city in 1985. More collaboration did 
not occur, vet center team leaders and support facility officials said, 
because relevant courses and seminars were not offered. 
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Figure 7.2: Effect ov Dis'"nce Between 
Vet Centers and Support Facilities on 
Whether Training Obtained (Fiscal Year 
1985) 



Percent of Facilities Obtaining Training 
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•For vet centers that opened before fiscal year 1985. 



Collaboration Between 
Vet Centers and PTS T ^ 
Units Needs 
Strengthening 



According to va, many Vietnam veterans have ptsd, a syndrome created 
by severely stressful or traumatic events, such as military combat, see- 
ing people die, or incarceration as a prisoner of war. Its symptoms 
include intense reliving of the event, anxiety, sleep disturbance, depres- 
sion, social isolation, and an incapacity for intimate relations with 
others. The Veterans' Health Care Act of 1984 (Public Law 98-528, Oct. 
19, 1984) authorized va to designate special progiams for the diagnosis 
and treatment of ptsd and required that when appropriate, the services 
provided under th^s program be coordinpted with services provided by 
the Readjustment Counseling Program. As of November 1986, va had 
designated special ptsd units at 13 of its medical centers. 1 



'In addition to the 13 designated units, at least seven medical centers had set aside a defined physical 
space fc '.eating PTSD patients. 
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The responses to our questionnaire indicated that, in fiscal year 1985, 
vet centers that opened before October 1, 1984, together identified over 
4,600 clients needing inpatient ptsd care; in fact, 99 percent of those 
centers identified clients in need of inpatient ptsd treatment. Eighty- 
eight percent referred a client to a ptsd unit. The centers, however, 
referred only one-auarter of their clients needing inpatient ptsd treat- 
ment to a ptsp unit. Eighty-one percert of the centers said that they 
treated some clients who needed 'npatient care; 71 percent said that 
they referred some of these clients to support facilities for treatment. 

The vet centers did not make more referrals primarily because of (1) 
lack of available beds, (2) distance, and (3) client needs and preferences. 

Lack of available beds : Three of the 12 support facilities visited (the 
Bay Pines, Northampton, and Pale Alto Medical Centers) had designated 
ptsd un ;s. The Bay Pines unit, with 20 beds : and the Northampton unit, 
with 30 beds, were full, officials told us, and additional veterans were 
waiting to be admitted. According to the Bay Pines official, the average 
waiting period was 6 months. The director of the ptsd unit at Palo Alto, 
which had PO beds, told us that 84 beds were filled. He said this was the 
normal occupancy, and veterans were rarely put on a waiting list unless 
it was their choice not to be immediately admitted. Officials *t 8 of the 
12 centers visited noted the unavailability of bed space as a reason for 
not making more referrals to the ptsd units. 

• D istance : About three-quarters of all vet certers w^re 100 or more miles 
from the closest ptsd unit; about one-quarter were 450 or more miles 
away. At over half the centers (five of eight) we visited that were 100 or 
more miles from a ptsd unit, team leaders told us distance was a reason 
that they did not make more referrals. 

• Client needs and preference s: At three centers we visited, team leaders 
told us they would not fir? refer a client to a ptsd unit if th* client had 
an immediate need for hospitalization or required treatment for other 
problems. A veteran must be free i:om substance abuse and acute psy- 
chiatric illnesses, officials from two ptsu ^nits toid us, to be considered 
for admission. Moreover, clients may not want to be admitted to a ptsd 
unit, team leaders from four centers told us, because they do not want to 
be away from their families or jobs for an extended period of time. 
According to va, most ptsd units plan for their patients to stay for from 
3 to 5 months. 



Vet Center Clients Needing 
Inpatient PTSD Care 
Frequently Not Referred to 
PTSD Units 
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va's Special Committee on ptsd, established by Public Law 98-528 to 
assess the agency's ability to treat veterans with the disorder, noted 
that continuity of care between vet centers and ptsd units may facilitate 
the treatment of those veterans and minimize their relapse. The commit- 
tee also noted that coordination permitted the efficient use of resources 
at both locations. As of February 1987, va did not have guidelines speci- 
fying how ptsd units and vet centers should coordinate their diagnosis 
and treatment of veterans with ptsd. 

Vet centers that referred clients to ptsd units in fiscal year 1985, accord- 
ing to responses to our questionnaire, almost always notified the units of 
the referral by letter or telephone. After the referral, however, most of 
the centers had little contact with the unit, as shown in table 7.1. 



Table 7.1: Contact Between Vet Centers and PTSD Units" 

Percent of centers that had contact: 



Always/ 



Type of contact 


almost 
always 


Sometimes 


Rarely/ 
never 


Not 

applicable 


Telephone/leMer notification of referral 


92 


5 


2 


1 


Meeting/contact verifying diagnosis 


41 


16 


35 


7 


Meeting/contact developing treatment plan for admitted veteran 


16 


18 


55 


11 


Meeting/contact developing alternate plan in lieu of admission or 
while waiting for admission 


25 


20 


45 


10 


Periodic meetings/ contacts discussing progress 


26 


23 


38 


13 


Notification of patient discharge 


26 


20 


41 


13 


Meeting/contact establishing follow-up treatment plan 


27 


20 


41 


12 


Meeting/contact discussing progress in follow-up treatment plan 


12 


23 


50 


Itf 



a For vl. centers that opened before October 1, 1984 



The questionnaire responses did not clearly indicate ttat distance 
between vet centers and the ptsd units was a factor i) coordin?* on. The 
majority of centers visited that referred clients to ptsd units in fiscal 
year 1985 did not fully communicate with the units, for example: 

• The Knoxville Vet Center center referred four clients to ptsd units in 
fiscal year 1985, the team leader there saic ; he did not, however, know 
if two of them had ^een admitted because the units in the Bay Pines and 
Cleveland Medical Centers did not provide aim feedback. 

• According to vet center and ptsd unit officials, staff from only one of the 
four centers we visited that we*e within 40 miles of a PfSD unit partici- 
pated in the unit's inpatient treatment program A St. Petersburg Vet 
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Center counselor told us that center staff conducted group sessions at 
the nearby ptsd unit in the Bay Pines Medical Center. 

• The Pawtucket Vet Center team leader told us his staff seldom contacted 
clients in the program who were referred to the ptsd unit in ^he North- 
ampton Medical Center; the vet center staff did not communicate at all 
with the ptsd unit staff during the clients' stay. According to the team 
.eader, this was because the ptsd unit staff assumed full responsibility 
for the treatment of the veterans. 

• The Albuquerque Vet Center team leader told us that although the 
center had eight clients admitted to the ptsd unit in the Topeka Medical 
Center in fiscal year 1985, staff from the two facilities did not discuss 
clients' treatment option? following hospitalization. He said the vet 
center independently developed its own pcsthospitalization treatment 
plans. 



Conclusions Most vet centers ^ support facilities collaborated in some way on 

administrative, clinical, and training matters. Clinical and training col- 
laboration, however, was affected by the distance between the vet 
center and its support f acilL> . Because some vet centers are closer to 
satellite outpatient clinics than to their designated support facility, we 
believe va should consider linking more vet centers to these clinics, if the 
clinics can provide the support needed by the centers. 

In addition to the law requiring, when appropriate, that ptsd and vet 
center services be coordinated, the Special Committee on ptsd has indi- 
cated that close contact between the vet centers and specialized ptsd 
inpatient units could improve the effectiveness of the treatment pro- 
vided the veterans. Although va may not be able to overcome many of 
the reasons limiting referrals from vet centers to inpatient ptsd units, we 
believe it can improve tho coordination between the units once referrals 
are made. Better communication could be accomplished through tele- 
phone and written correspondence if distance precludes face-to-face 
contact. This communication would help assure veterans received coor- 
dinated care before, during, and after their stays at ptsd units; if they 
were not admitted to the units, this communication would help assure 
that they /eceived appropriate alternative care. 
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Recommendations to 
the Administrator of 
Veterans Affairs 



We recommend that the Administrator direct the chief medical director 
to 

determine whether any outpatient clinic located closer than the current 
support facility could better provide Hinical and training support to a 
vet center and 

strengthen collaboration between vet centers and ptsd units by requiring 
these facilities to establish formal communication concerning all clients 
referred from one to the other. 



AfienCV Comments ^ n ^ S ^ une * * l etter > t ^e Administrator concurred with both recommen- 

® y dations. By July 31, 1987. he expects to forward guidance to the field 

(1) instructing vet centers and va outpatient clinics that are near each 
other to participate in each other's clinical and training activities and (2) 
requiring collaboration betw^n vet renters and ptsd units, according to 
standards of sound clinical practice. The Administrator stated that 
increased information sharing between the ptsd units and vet centers 
had already begun, including the participation of vet center staff in ptsd 
regional conferences. 
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Regional office staff are required to make periodic clinical and adminis- 
trative site visits to vet centers. Because of staff shortages and other 
time demands, however, staff at the regional offices we visited were not 
making as many of these visits as required. The Readjustment Counsel- 
ing Service has other mechanisms, such as periodic reports, teleconfer- 
ence calls, and group meeting?, for monitoring program activities and 
keeping communication between facilities open. Generally, these mecha- 
nisms were being used. Because site visits are critical mechanisms that 
regional staffs have foi monitoring certain program activities and iden- 
tifying areas needing improvement, we believe site visits should be made 
as require^. 



The Readjustment Counseling Service director considered site visits to 
vet centers by regional office staff to be a critical part of the effective 
management of the program. He told us that such visits are important to 
bridge the geographic distance between team leaders and their regional 
supervisors and to monitor program elements that cannot be monitored 
through other mechanisms. According to the director, administrative 
site visits are needed to observe the appearance and use of the center, 
the adequacy of staff meetings, relations with support facilities, and 
staff competence and functioning; clinical site visits are needed to evalu- 
ate the centers' clinical operations, including reviewing clinical files and 
evaluating the centers' clinical collaboration with their support 
facilities. 

We reviewed reports of site visits made, in fiscal year 1985, to the cen- 
ters we visited and found that most reports documented problems or 
issues needing n.anagement attention. For example, the report of a 
clinical visit to the Jackson Vet Center noted that the center needed to 
improve clinical services to couples and significant others and increase 
outreach efforts to female and Native American veterans. The reports of 
clinical visits to the Boston and San Jose Vet Centers noted that their 
clinical filing systems needed overhaul and that client follow-up and 
case closing were inadequate. 

The regional offices' fr :al year 198C management objectives required 
that officials make a specified number of site visit. . The requirement 
varied among regions, out generally regional staff had to evaluate each 
center's administrative and clinical operations at least once during the 
year. For associate regional managers for Counseling, performance 
requirements specifically required them to make three clinical site visits 
a month, visiting each center at least once during the year. The content 
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of clinical site vis : ts was specified by a program-wide report format. The 
format used between December 1984 and June 1986 covered an assess- 
ment of centers' counseling and other services provided, staff develop- 
ment and interaction, outreach and community networking, and 
relations with support facilities. In June 1986, the clinical site visit 
report format was changed to focus more on clinical, rather than admin- 
istrative, issues. The content of administrative site visits was not speci- 
fied. The regional officials we interviewed, however, noted a variety of 
topics that they covered during such visits, including staff burnout; 
team performance and interactions; productivity; relations with support 
facilities, community organizations, arid clients; and some clinical issues. 

The regions we visited did not always conduct the number of site visits, 
particularly administrative visits, as required by their management 
objectives, but in fiscal year 1985 regional officials did make clinical vis- 
its tj 10 of the 12 centers we visited, as shown in table 8.1. 





Table 8.1: Site Visits Made by Regional Officials (Fiscal Year 1985) 


Region 


Requirement 


Vet center 


Visits made 


I 


At least four administrative/ clinical visits to each center; at le~st 
one in-depth clinical assessment of each center 


Pawtucket, Rl 
Springfield, MA 
Bangor, ME 
Boston, fv'A 


1 clinical 
1 clinical 

1 administrative/ clinical- 
1 chnical b 


III 


At least two administrative/ clinical visits to each center, at least 
two ir-depth clinical assessmer ts of each center 


Jackson, MS 
St Petersburg, FL 
Knoxville, TN 
Greenville, SC 


1 clinical, 

1 administrative 1 

clinical 

1 clinical 

1 administrative 


VI 


At Itast one administ ative and one clinical visit to each center 


Oakland, FL 
San Jose, CA 
Albuquerque, MM 
Las Vegas, NV 


2 clinical; 
1 administrative 
1 clinical 
1 clinical 
none 



a The region ! regional manager told us this visit was made, but he could not provide us 'ith 
documentation 



b ln addition, region I officials made four special-purpose visits to the Boston v'^t Centei Three \ /ere to 
, eview the c iter's monitoring of program contractors, and one was to interview car»d H ^os for vacant 
vet center positions 

The regional officials interviewed noted that they were not making site 
visits as required mainly because of staff and funding shortages and the 
demands of other responsibilities. Concerning staff shortages, the region 
VI regional manager told us he was on sick leave for 4 months in fiscal 
year 1985, leaving the deputy regional manager to handle operations 
alone. From January 1985 to August 1985, the region I regional manager 
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served as both acting regional manager and associate regional manager 
for Counseling. The priority placed by the director on making clinical 
visits, officials at two regional offices visited noted, caused funding 
shortages for making administrative site visits. 1 

Officios at all three regions visited said their other responsibilities lim- 
ited the number of site visits they could make. For example, the regional 
managers in regions I and III said they spent much of their time in fiscal 
year 1985 on activities related to the opening of new centers. One of the 
two associate regional managers for Counseling in region VI told us she 
had other responsibilities, such as coordinating regional training, that 
prevented her from making all the site visits required. She also noted 
that region VI covered a large geographic area, making travel difficult. 
She said she had been able to make an average of only two clinical site 
visits a month. Effective July 1, 1986, the Readjustment Counseling Ser- 
vice created a seventh program region, ir part to ease the travel and 
workload burden of region VI. Ten of the 43 centers that were in region 
VI are now in region VII. 



Other Monitoring and 
Communication 
Mechanisms Being 
Used 



The three regions we visited required their vet centers to submit quar- 
terly reports on personnel changes, use of supplementary staff, commu- 
nity activities, clinical and administrative contacts with va staff, and 
crisis events. (Region III also required monthly reports.) Regions I and 
III requested their centers to submit additional information on program 
operations, such as (for region III) a description of group counseling ses- 
sions held and staff continuing education activities. The central office, 
in turn, required the regions to subm' quarterly reports summarizing 
their centers' activities. 



In addition to making site visits, regional offices monitor their vet cen- 
ters by requiring them to submit periodic repoits, participate in telecon- 
ference calls, and attend regional meetings. The Readjustment 
Counseling Service's central office, in turn, does the same with the 
regional offices. We found that, in general, the central office and the 
regional offices we visited were using these monitoring and communica- 
tion mechanisms. 



In *he early years of the program, VA did not obligate all funds available, either reprogrammin • 
fui .s to other programs or allowing them to lapse. In fiscal year 1985, however, VA obligated 99 4 
perce.it of the funds available to the vet center program. 



ERIC 



Page 75 y 7 GAO/HRD-87-63 Vet Counseling Centers 



Chapter 8 

Monitoring Vet Center Activities Could 
Be Enhanced 



Most regions' management objectives required the regional staff to con- 
duct weekly conference calls with their vet centers to discuss and dis- 
seminate program information. Generally, both regions III and VI 
regional managers conducted the weekly calls; regional officials told us 
that all centers .ticipated in these calls. Region I management objec- 
tives did not require conference calls with vet centers, but the regional 
manager conducted them generally twice a month. He said all team lead- 
ers usually participated in these calls. The director also conducted 
weekly conference calls with the regional staffs. 

All three regions visited held at least one . aeting (including a training 
session) for their team leaders in fiscal year 1985. As discussed in chap- 
ter 5, these meetings covered administrative and clinical issues. The cen- 
tral office conducted quarterly meetings for regional and deputy 
regional managers to discuss current program issues. 



ConciUSiOnS Regional officials' site visits to vet centers are useful in managing pro- 

gram operations because the centers are geographically distant from 
program supervisors and physically separated from otoer va facilities. 
Some reasons officials gave for not making more frequent site visits no 
longer exist. For example, a seventh regional office was established 
partly to ease the workload on region VI, and the tasks of program 
expansion have been completed. In addition, as of December 1986 all 
seven legions had permanent regional managers and, with the exception 
of one vacancy, associate regional managers for Counseling. 

As mentioned in chapter 2, program funding is not expected to increase. 
However, program costs will probably increase because of pay raises 
and other inflationary effects. Therefore, we would expect the regional 
management to have more funding shortages and more difficulty mak- 
ing the required number of clinical and administrative site visits. We 
believe that program managers in the central office should monitor the 
extent to which regional managers are making required site visits and, if 
necessary, adjust the requ'rements to be consistent with funding availa- 
ble. For those centers where regional managers are not able to make 
enough site visits to adequately monitor activities the program may 
want to rely on input from the centers* support facilities. 
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Recommendations to 
the Administrator of 
Veterans Affairs 



We recommend that the Administrator direct the chief medial director 
to do the following: (1) emphasize the need for regional officials to mate 
their required site visits; (2) monitor whether the officials are making 
the visits as reouired; and (3) where not erough visits are being made, 
request that the support facilities monitor the administrative and 
clinical activities at the centers. 



Agency Comments In his June 1 1 letter > the Administrator concurred with these recommen- 

dations. He stated that during April 1987 all regional management olfi- 
cials were instructed to complete the required number of administrative 
and clinical site visits for fiscal year 1987. A monthly report to the cen- 
tral office from each region, documenting the number of visits made in 
the fiscal year to date, was instituted. 
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va has littie assurance that vet centers provided h*gh quality care to 
their clients. Neither the va central office nor centers' support facilities 
routinely conducted program quality assurance reviews. Moreover, less 
than adequate clinical recordkeeping practices and file review proce- 
dures limited the ex' ant to which the quality of care could be assessed. 



Providing quality health care is one of va's primary goals. To assure that 
its medical centers provide quality care, has developed two programs 
(as required by 38 C.F.R. T.500): (1) the systematic external review pro- 
gram, involving dm&s regional office reviews 1 of the quality of care pro- 
vided by each medical center and the center's quality assurance 
program and (2) the systematic internal review, involving individual 
medical center reviews of the quality of care provided to its patients. 
The internal review must include continuous monitoring of key indica- 
tors of the quality of care provided, including reviews of psychiatric 
programs and medical records. 

The systematic external review program applies to all va medical facili- 
ties, but vet centers are not included in va's definition of a medical facil- 
ity (38 C.F.R. 17.500 (d)). In July 1986, the Readjustment Counseling 
Sen/ice director told us systematic external reviews of vet centers had 
never been conducted. 

va medical center directors, who are responsible for implementing the 
systematic internal reviews, are given considerable flexibility in how 
they carry out this function. Support facility officials told us that none 
of the centers we visited, with the exception of the Knoxville Vet 
Center, were included in internal reviews. According to a Knoxville Vet 
Center support facility official, that vet center is included in the suport 
facility's internal reviews. We found, however, that the center's involve- 
ment was limited to annual self-assessments. 

Although we did not ask specifically, officials from three support facili- 
ties told us they conducted vulnerability assessments 2 of their vet cen- 
ters. For example, based on an assessment of the Springfield Vet Center 



1 During fiscal year 1986, DM&S switched responsibility for these external reviews from the central 
office to the DM&S regional offices (which, as mentioned in ch 1, are distinct from the Reacvjustment 
Counseling Service regional offices). 

2 The vulnerability assessment is part of the internal control system required by the Federal Mana- 
gers' Financial Integrity Act of 1982 It is a review of the susceptibility of a program to unauthorized 
use of ra arces, errors in reports and information, illegal or unethical act$ or adverse public opinion. 



Quality Assurance 
Reviews Not 
Conducted 



o 
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in fiscal year 1985, the support facility liaison officer reviewed five cli- 
ent records and the vet center staff's crisis intervention capabilities. The 
review indicated that (1) the 'lies were appropriately documented 
except for notes on administrative, financial, or benefits issues and (2) 
the staff knew the resources available to deal with problem situations 
and received crisis intervention training. 



Clinical Recordkeeping 
Practices and File 
Review Requirements 
Not Adequate 



va requires its vet centers to maintain clinical notes so that the counsel- 
ing process can be effectively managed. It further requires regional offi- 
cials and team leaders to review the clinical folders to ensure that 
"quality readjustment counseling services" are provided. However, our 
review of the 12 vet centers and 3 regional offices indicated that (1) 
clinical recordkeeping varied among counselors but was generally not 
adequate and (2) file review requirements did r ot specify the frequency, 
magnitude, or content of the reviews, or how they should be 
documented. 



Clinical Recordkeeping Not Since June 1982 vet center staff have been required to develop individ- 
Adequate ual counseling plans for clients, including a description of the client's 

problem(s), pertinent background information, and the actions intended 
to be taken to resolve the problem(s). Once a counseling plan had been 
established, staff were also required to regularly prepare progress notes 
and to prepare a case-closing summary describing the status of the cli- 
ent's functioning at the time of case closing. Over the course of the pro- 
gram, the recordkeeping requirements have become more specific. For 
example, in August 1984 a specific format was required for recording 
progress notes. 

Three of the nine clinical site visit reports on vet centers that we 
reviewed noted clinical recordkeeping problems. An assistant regional 
manager for Counseling told us that a fourth center also had problems, 
but these problems were not documented in the center's site visit report. 
In one case, the person who was team leader at the center throughout 
most of fiscal year 1985, we were told, did not require his staff to pre- 
pare clinical notes because he wanted to assure that information about 
each client remained confidential. 



Two remaining centers that had recordkeeping problems were in region 
VI. According to an October 1985 report from its two assistant regional 
managers for Counseling, not all counselors had the skills necessary to 
maintain adequate clinical records; this impression was based on visits 
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to almost every center in that region. In June 1986, one of the assistant 
regional managers for Counseling told us that clinical recordkeeping was 
still a problem but was improving. 

In fiscal year 1935, all three regions visited provided training in clinical 
recordkeeping to their staff. The assistant regional managers for Coun- 
seling also told us they provided individual assistance as necessary dur- 
ing site visits, distributed examples of good clinical notes, and discussed 
requirements during regional conference calls. 

The principal psychologist on our staff reviewed a sample of 100 clinical 
files from the i 2 centers visited to determine the extent to which the 
clinical notes contained the basic information required. She found that 
about one-third of the files inadequately documented the reasons for th? 
clients' visits and the assistance given them. Forty-four percent of the 
files inadequately documented the clients' progress since the initial visit 
and the counselors' current plans for resolving the clients' problems, for 
example: 

According to contact sheets submitted to the data processing center (see 
ch. 4). one client came to the Boston Vet Center about once a month 
between April 1385 and November 1985, but no progress notes were 
ever written describing the client's problems, what was being done to 
assist her, or the progress she made. 

• According to contact sheets, a client came to the San Jose Vet Center 
five times between April 1984 and May 1985, but no progress notes 
were written describing the client's problems, the client's progress, or 
the assistance provided. 

• Progress notes for a client who came twice to the Bangor Vet Center in 
1984 stated on 1 '' "vet entered into system" and "vet in for coffee and 
rap." 

• According to progress notes, a client attended 22 group-counseling ses- 
sions at the Pawtucket Vet Center between March and November 1985, 
but the notes did not indicate the client's progress in resolving his prob- 
lems during this period. 

In contrast to these examples, the following is a description ot adequate 
.ocumentation: 

• Progress notes indicated that a client and his wife together or separately 
had eleven contacts with the Knoxville Vet Center in the summer of 
1984. In this case, the progress notes extensively described the client's 



ERIC 



,~ Page 80 GAO/HRD-87-63 Vet Counseling Centers 

82 



Chapter 9 

VA Has Little Assurance That Vet Centers 
Provided Quality Care to Clients 



problem, assist nee given him and his wife, and the progress he had 
made in resolving his problem. 



File Review Procedures An August 1984 DM&S circular states the following To ensure "qualify 
Were Not Specific readjustment counseling services" and appropriate clinical documenta- 

tion, the assistant regional managers .or Counseling and team leaders 
are responsible for reviewing client folders of eac' . vet center staffer 
with counseling duties. The circular, however, does not specify the fre- 
quency, magnitude, or ontent of the reviews, or how the- should be 
documented. 



According to the circular, the assistant regional managers for Counsel- 
ing and team leaders are required to "periodically" review vet centers' 
files. The assistant regional managers, at the three regions we visited, 
said they rev. ;wed files during their clinical site visits. This meant that 
they reviewed files only once, during fiscal year 198o, at nine centers 
tney visited, twice at one center, and not at ali at two centers. The fre- 
quency of most team leader reviews at the sites we visited varied from 
weekly to quarterly. One team leader said thu, he did not review files at 
all. Another said that his reviews occurred when he happened to (1) see 
another counselor's client and thus had reason to look through that cli- 
er , s files or (2) be at the file cabinet to pull one of his files and decided 
to randomly select two or three others for review. 

In addition, the DM&s circular does not require that a specific number of 
files be reviewed by assistant regie, \\ managers for Counseling and 
team leaders. 3 The number reviewed at the centers visited varied. For 
examole, some team leaders told us thev exair.'ned a total of 10 or fewer 
files during their monthly or quarterly review 's; others told us that they 
reviewed the files of every active client. The region I regional manager 
told us that when he made clinical site visits in fiscal year 1985, he 
reviewed 10 to 12 files at each site. Officials from the other two regions 
visited told us that they reviewed as many as 20 during each visit. One 
purpose of the file rc "ijw is to assess the quality of servioes provided. 
However, the site visit report format used from December 1984 through 
June 1986 did not explicitly require assistant regional m magers for 
Counseling to comme.it on the q tality of care provided. The current site 
visit report format requires assistant regional managers for Counseling 



3 A Decern!*. 1986 draft Program Guide requires team leaders to review each case at least once dur- 
ing the counseling process 
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to examine documentation, but does not explicitly require them to exam- 
ine the quality of care provided. Of the nine site visit reports we 
reviewed, only one (the repo.t on the Knoxville Vet Center) addressed 
quality of care. Moreover, two team leaders told us that Jieir reviews 
were primarily for the purpose of identifying inactive cases. 

Finally, the DM&s circular does not require assistant regional managers 
for Counseling and team leaders to document their reviews of individual 
ca^e files. 4 Officials from the two regions we questioned (regions I and 
III) said they documented thair reviews in site visit reports, but did not 
document the reviews in the individual case files. Six of the 11 team 
leaders who reviewed files told us they did not document their reviews 
of individual files. 



Conclusions 



Although the Readjustment Counseling Se/dce established mechanisms 
to assure quality care (clinical file reviews by regional officials and team 
leaders), it had little assurance that its centers were providing quality 
care because clinical recordkeeping practices and file review procedures 
were not adequate. We believe that, as p*vt of dm&s, the Readjustment 
Counseling Service should ^e subject to the same quality reviews, 
including the systematic internal reviews made by medical centers, as 
dm&s's other health care delivery services. 



Recommendations to 
the Administrator of 
Veterans Afiairs 



We recommend that the Administrator, through the chief medical 
director, 

roquire the dm&s regional offices to include the vet centers in their sys- 
tematic external review programs; 

require medical center directors to include vet centers in their system- 

: internal reviews; and 
establish specific requirements for regional and team leader reviews of 
clinical files, including specifying the minimum frequency, magnitude, 
and documentation requirements, as well as requiring the reviewers to 
comment on quality of care provided to clients. 



a rtAri/w Prkmrnontc In his June 11 letter > the Administrator concurred with the first and 

Agency OUIlUlienib third reco mmendations. He ated that by the end of fiscal year 1987, a 



4T he December 1986 draft Program Guide requires the reviewer tc sign the file to indicate the case 
was reviewed. 
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task force will provide recommendations for accomplishing the system- 
atic external reviews of vet centers. In addition, va is revising the site 
visit format for regional management to indicate minimum frequency 
and documentation requirements for reviews of clinical files, va did not, 
however, address our recommendation to establish specific require- 
ments for team leader reviews of clinical files. 

va agreed in principle with our second recommendation. According to 
the Administrator, the vet center team leaders and lef onal management 
staff will begin conducting systematic interr 1 reviews, however, it 
would be inappropriate to require medical center directors to include vet 
centers in their systematic internal review activities because medical 
centers do not direct vet -enter operations. But medical center directors 
may, he added, conduct internal reviews of selected aspects of vet cen- 
ters as p^«t of the medical center's internal review program. 
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Med States Senate 

COMMUTE! ON VETERANS' AFFAIRS 
WASHINGTON, O.C 20610 

November 1 , 1984 



Honorable Charles A. Bowsher 
Comptroller General of the United States 
General Accounting Office 
441 G Street, N.W. 
Washington, D.C. 20548 

Dear Mr. Bowsher: 

I am writing a/ Chairman of the Senate Committee on Veterans' 
Affairs to request that the General Accounting Office (GAO) 
conduct a review of the Veterans' Administra' .on' s Vietnam Veterans 
Readjustment Counseling Program. Public Law 96-22, the Veterans' 
health Care .Amendments of 1979, provided the authority for the VA 
to furnish readjustment counseling services to Vietnam-era veterans. 
Under chat law, eligible Vietnam veterans had 2 years from the 
date of their discharge -- or until September 30, 198 A - to make 
an initial request for counseling. In 1981, Public Law 97-72, 
the Viterans' Health Care, Training and Small Business Loan Act 
of 1981, extended the period o' eligibility to request readjustment 
counseling by 3 years -- until Septemoer 30, 1984. Most recently, 
Public Law 98-160, the Veterans' Health Care Amendments of 1983, 
provided /ietnam-era veterans with permanent eligibility for 
readjustment counseling by eliminating the date by whic they may 
request readjustment counseling from the VA. 

In light of the Congress' continuing interest in, and commitment 
to, the readjustment counseling program, I believe a review by 
the GAO wou' 1 aid the Congress and the VA- in their ability to 
monitor the use, effectiveness and need for continuation of the 
program in its present, or *n mother, form. The program is 
being evaluated currently oy the VA's Office of Program Planning 
and Evaluation and by the VA's ReadjusVment Counseling Planning 
Task Force. It is my view that a GAO review would provide an 
additional assessment and contribute to a more thorough evaluation 
process . 

In order to assist the Congress and the VA in this matter, 
it would be most helpful «if the GAO's review would consider among 
others the following specific aspects of tne program: 

1. Clients. Please provide information on the use of the 
"Vet Centei" program by Vietnam veterans a. d others and their 
families. Include in your account a breakdown, by certain categories, 
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Honorable Charles A. 3owsher 
November 7, 1984 
Page 2 



of the specific client groups who seek read j us tmen t counseling, 
including but not limited to age, number, and percentage 
of Vet Center clients who nave service-connected disabilities. 

2. Services. Please provide information on the service 
provided, including follow-up services, and the qualifications 
and training of readjustment counseling staff. 

3. Demand. Please provide information on the readjustment 
and other problems for which veterans have sought readjustment 
counseling and information on the similarities and differences m 
veterans '*ho are requesting counseling tor the first time compared 
to thore who have been served throughout the life of the program. 

4. Prog am Accountability. Please provide an assessment c* 
certain structural components of the program, including program 
administration, management, and recordkeeping and oversight by 
the VA Central Office of the aforementioned items. 

5. Coordination with inpatient tre« ent pr "rams. Please 
assess the extent to which the treatment in a VA nedical center 
ct /eterans who suffer from Post Traumatic Stress Disorder (PTSD) 
is coordinated with services provided at a Vet Center to such 
veterans, including services before and after a period of hospital- 
ization. ' 



6. Relationship to other entities. Please evaluate the 
working reiatxonship between the program and Vietnam veterans, VA 
medical centers, VA Central Office, community treatment nroarains , 
and the general public. ' 

7. Elfectiveness . Please review the overall effectiveness 
ot the program and its particular effectiveness Mth respec* to 
certain client r -uuiations with readjustment and other problems. 



8. Location. When the program was initiated 5 
the storefront cente-s were designed to overcome the 



of certain Vietnam veterans to use the 
need for retaining the Vet Centers in 



VA. Please 
'storefront" 



years ago, 
re 1 uc tancc 



review the 
1 oca t ions . 



It would be most useful to me if you would keen me informed 
periodically of your progress. 



Thank you 
information is 
Victor Raymond 



for your cooperation and assistance. If additional 
needed . egardmg this request, please contact 
(224-9126) of the Cummittee stafr. 



Wi th warm regards , 




ChaiVmaii 



CC : Honorable Harry \, Walters 
Honorable Alan Cranston 
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(continued) 



a Vet center included m GAO review 
b U = urban, S = suburban, and R = rural 

C C = comb,ned, U/S = urban/suburban, and R/S = rural/suburban 

d Toials may not equal 100 percent because wa accepted questionnaire >sponoents' fiaures if thev 
totaled 90-110 percent * 

e N<,mt?3f of Vietnam 3ra veterans identified as needing inpatient PTSD treatment in fiscal year 1985 
Note A blank indicates no response 
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(continued) 

a Vet center included ir. GAO review 

b U = urban, S = suburban, and R = rural 

C C = combined, U/S = urban/suburban, and R/0 = rural/suburban 

^Totals may not equal 100 percent because we accepted questionnaire respondents' fiqures if thev 
totaled 90-1 10 percent 

c Number of Vietnam era veterans identified as need ng inpatient PTSD treatment in ' sc*l year 1985 
Note A blank indicates no response 
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1980 


S 


R/S 


FayetteviHe, NC 


1980 


u 


U/S 


Fresno, CA 


1982 


u 


U/S 


Ft Lauderdale, FL 


1979 


u 


U/S 


Ft Wayne, IN 


1980 


u 


U/S 


Ft Worth, TX 


1982 


u 


U/S 


Gallup, NM 


1981 


R 


R/S 


Gary, IN 


198„ 


S 


U/S 


Grand Rapids, Ml 


1982 


u 


U/S 


Grants Pass, OR 


1985 


H 


D /C 


Greensboro, NC 


1986 


s 


c 


Greenville, f .C 


1986 


u 


C 


Greenville, SC a 


193? 


u 


U/S 


Harrisburg, PA 


1932 


u 


U/S 


Hartford, CT 


1980 


u 


c 


Honolulu, HI 


1980 


u 


U/S 


Houston, TX 


1980 


u 


U/S 


Houston, TX 


1985 


u 


U/S 


Huntington, WV 


1980 


R 


R/S 


Huntingtcn, WV 


1980 


U 


c 


Indianapolis, IN 


1980 


u 


U/S 


Jackson, MS a 


1980 


R 


R/S 


Jacksonville, FL 


1980 


U 


J/S 


Jersey City, NJ 


1979 


u 


U/S 


Johnson City, TN 


1935 


R 


P/S 
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Appendix II 

Selected Characteristics of Vet Centers (as 
Reported in Questionnaire) 



Vietnam era — 


Vietnam era veteran race/ethnic oriai 


n 


Male 
Vietnam era 
veterans 
(percent) 


Distance to 
VA support 
facility 
(miles) 


Vietnam era 
veterans 
needing 
PTSD 
treatment* 
( r ercent) 


Distance to 
nearest 
designated 
PTSD unit 
/miles) 


v At a ran 




(percent) 




population 


White 


oh <3K 


Other 


20,000 


/u 


c 
O 


25 


90 


7 


• 


• 


75,000 


CO 
DO 


OQ 
CO 


4 


90 


3 


20 


500 


65,000 


oy 


0 


25 


95 


4 


52 


• 


93,000 


/u 


15 


15 


98 


30 


36 


300 


60,000 


o4 


A 1 

12 


4 


95 


2 


25 


200 


43,050 


oo 


7 


5 


96 


40 


20 


500 


10,000 


Q 

o 


o 
0 


89 


95 


150 


10 


322 


30,000 


ou 


oU 


20 


95 


50 


20 


100 


102,070 


C ' 
00 


1 n 
1U 


6 


99 


56 


20 


190 


30,000 


97 


1 


3 


99 


30 


• 


400 


65,000 


60 


35 


5 


90 


60 


10 


300 


30,000 


40 


60 


0 


97 


125 


17 


50C 


40,000 


79 


;o 


1 


95 


110 


75 


125 


76,000 


80 


17 


3 


91 


35 


60 


90 


54,500 


70 


25 


5 


95 


9 


30 


52 


38,000 


35 


1 


64 


96 


2 


48 


2,500 


105.0C0 


30 


60 


10 


98 


3 


107 


728 


103,000 


58 


26 


16 


99 


13 


10 


500 


39,000 


90 


10 


0 


95 


12 


20 


350 


30,000 


90 


9 


2 


99 


60 


2 


300 


163,. 30 


86 


12 


2 


97 


3 


15 


197 


42,000 


55 


40 


5 


98 


4 


75 


45^ 


38,280 


60 


35 


5 


93 


71 


50 


211 


98,970 


40 


30 


30 


98 


12 


60 


40 


45,000 


90 


5 


e 


98 


2 


9 


350 



(continued) 

a Vet center included in GAO review 



b U = urban, G = suburban, and R = rural 

C C = combined, U/S = urban/suburban, and R/S = rural/suburban 

d Totals may not equal 100 percent because we accepted questionnaire respondents' figures if thtv 
tota'ed 90-ii0 percent 

e Number of Vietnam era veterans identified as needing inpatient PTSD treatment in fiscal year 1985 
Note A blank indicates no response 
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Selected Characteristics of Vet Centers (as 
Reporter in Questionnaire) 



VPl Nellie. 




Year began 

nnoratinn 
UpciallUll 


Location of 
center 


Location of 
citems 






1Q7Q 


1 1 

u 


i i/q 
u/o 


Kpnai AK 




1 570 1 


u 


1 l/Q 

U/O 


r\i «v a vine , i in 






1 1 

u 


1 l/Q 

U/O 






1 JOU 


; I 


1 l/Q 

U/O 


1 ae VpnflC N\/3 
Lao vcyoo, i\ v 




i you 


1 1 

u 


1 1 /Q 

U/O 


1 PYinntnn 
lcaii 1, l\ I 






1 1 

u 




1 mrr MF 




1 570 1 


1 1 

u 


1 l/Q 

U/O 


1 innrini ParU Ml 




I you 


q 
O 


1 1 /Q 
U/O 


Little Rock, M 




1980 


u 


U/S 


Los Angeles, CA 




1980 


U 


U/S 


Los Angeles, CA 




1979 


u 


U/S 


Louisville, Ky 




19o0 


u 


U/S 


Lowell, MA 




1985 


u 


U/S 


Lubbock, TX 




1986 


R 


U/S 


Madison, Wl 




1982 


ij 


• 


Manchester, NH 




1980 


u 


U/S 


Manhattan, Nt 




1980 


u 


U/S 


Martmsburg, WV 




1985 


u 


R/S 


McAllen, TX 




1980 


u 


U/S 


Memphr 1 




1980 


u 


U/S 


Mtarr.i, FL 




1980 


u 


U/S 


Midland, TX 




1986 


R 


R/S 


Milwaukee, WS 




1980 


U 


U/S 


Mmot, ND 




1982 


R 


RS 


M, soula, MT 




1985 


S 


U/S 



.94 
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Selected Characteristics of Vet Centers (as 
Reported in Questionnaire) 



Vietnam era 

veterans Distance to 



Vietnam z~ 
veteran 


Vietnam era veteran race/ethnic oriqin d 


Male 

vidiiciiii via 

veterans 
(percent) 


Distance to 

facility 
(miles) 


needing 

DTCn 

treatment* 
(percent) 


nearest 
designated 
PTSD unit 
(miles) 




(percent) 




population 


White 


Black 


Other 


55,000 


60 


30 


10 


95 


3 


4 


60 


2,000 


90 


1 


6 


98 


150 


• 


• 


65,000 


84 


13 


3 


98 


185 


• 


360 


2,500 


10 


0 


90 


98 


150 


10 


1,100 


OA AAA 

30,000 


67 


15 


23 


85 


2 


5 


250 


26,499 


91 


9 


0 


99 


1 


25 


300 


13,570 


80 


5 


15 


95 


6 


5 


250 


4 OA AtA 

160,970 


60 


32 


8 


98 


4 


35 


200 


88,000 


80 


18 


2 


95 


5 


700 


640 


250,000 


8 


75 


17 


96 


10 


• 


620 


377,000 


64 


33 


13 


97 


4 


20 


400 


60,990 


75 


21 


4 


98 


7 


8 


130 


27,000 


94 


2 


4 


99 


33 


5 


95 


14,000 


60 


17 


24 


92 


126 


• 


• 


80,000 


88 


10 


2 


99 


4 


15 


100 


30,000 


98 


1 


1 


96 


1 


60 


100 


46,000 


15 


40 


45 


90 


3 


20 


40 


35,000 


92 


5 


3 


97 


4 


5 


200 


13,500 


30 


1 


69 


99 


2 


5 


1,200 


75,000 


45 


45 


10 


97 


2 


5 


400 


70,000 


40 


35 


25 


97 


3 


250 


250 


32,000 


69 


6 


25 


98 


45 


• 


• 


67,000 


70 


20 


10 


92 


3 


35 




15,000 


92 


1 


8 


98 


278 


7 


• 


• 


50 


10 


40 


80 


120 




600 



(continued) 

a Vet center included in GAO review 



b U = urban, S = suburban, and R rural 

C C = combined, U/S = urban/suburban, and R/S = rural/suburban 

d Totals may not equal 100 percent because we accepted questionnaire respondents' fiqures if they 
totaled 90 110 percent 

e Number of Vietnam era veterans identified as needing inpatient PTSD treatment in fiscal year 1985 
Note A blank indicates no response 
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Appendix II 

Selected Characteristics of Vet Centers (as 
Reported In Questionnaire) 



Vet center 


Yftnr hftnnn 

IDQI UvUBII 

operation 


1 nf ntinn nf 

center 


1 noatlnn a! 

clients 


v.obile, AL 


1982 


U 


U/S 


Moline, IL 


1985 


U 


u/s 


Monroeville, PA 


1981 


s 


u/r 


Montabello, CA 


197y 


s 


u/s 


Morgantown, WV 


1982 


R 


R/S 


N Charleston, SC 


1980 


U 


U/S 


N Chicago, IL 


1986 


U 


• 


New Bedford, MA 


1986 


U 


U/S 


New Haven, CT 


1979 


U 


c 


New Orleans, LA 


1980 


U 


u/s 


Newark, NY 


1979 


U 


u/s 


Norfolk, VA 


1980 


U 


u/s 


Northndge, CA 


197S 


u 


• 


Norwicn, CT 


1985 


u 


u/s 


Oak Park, IL 


• 


s 


u/s 


Oakland, CA a 


1981 


u 


u/s 


Oakpark, Ml 


1980 


u 


u/s 


Oklahoma City, OK 


1980 


u 


u/s 


Omaha, NE 


1980 


u 


u/s 


Orlando, FL 


1983 


u 


u/s 


Palm Beach CO, FL 


1985 


s 


R/S 


Pawtucket, Rl a 


1980 


u 


U/o 


Pensacola, FL 


1985 


u 


c 


Peoria, IL 


1981 


R 


c 


Philadelphia, PA 


1 979 


u 


u/s 
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Selected Characteristics of Vet Centers (as 
Reported in Questionnaire) 



Vietnam era 



Vietnam era 

VClClul 1 


Vietnam era veteran race/ethnic oriqin d 


Male 
Vietnam era 
veterans 


Distance to 
VA support 
facility 
(miles) 


veterans 
needing 
PTSD 
treatment* 
(percent) 


Distance to 
nearest 
designated 
PTSD unit 
(miles) 




(percent) 




population 


White 


Black 


Other 


(percent) 


44,000 


58 


40 


2 


90 


60 


10 


350 


60,000 


90 


6 


4 


95 


60 


5 


300 


81,640 


64 


30 


6 


88 


11 


15 


135 


200,000 


48 


8 


44 


99 


15 


10 


500 


36,150 


98 


2 


0 


99 


48 


50 


300 


120,000 


55 


35 


10 


95 


5 


25 


120 


120,0 JO 


80 


15 


5 


• 


• 


• 


• 


30,000 


60 


8 


32 


85 


30 


• 


150 


28,360 


55 


35 


10 


95 


3 


15 


300 


42,000 


55 


44 


1 


90 


2 


25 


600 


77,270 


50 


26 


14 


96 


6 


10 


47 


25,000 


40 


52 


8 


95 


12 


20 


325 


70,000 


70 


9 


22 


95 


5 


40 


800 


20,000 


80 


10 


10 


95 


50 


10 


80 


40,000 


55 


35 


10 


95 


5 


15 


40 


35,000 


50 


35 


15 


90 


35 


30 


40 


160,000 


60 


38 


2 


97 


35 


5 


275 


82,340 


70 


20 


10 


90 


3 


65 


400 


26,000 


70 


20 


10 


90 


2 


15 


180 


95,880 


70 


20 


10 


96 


75 


25 


90 


20,000 


50 


30 


20 


90 


75 


10 


200 


42,000 


70 


20 


10 


99 


5 


60 


100 


44,000 


77 


19 


4 


90 


130 


4 


450 


150,000 


50 


40 


10 


85 


130 


50 


200 


1 16,720 


55 


39 


6 


92 


6 


150 


40 


(continued) 



a Vet center included in GAO review 

b U = urban, S = suburban, and R = rural 

C C - combined, U'S = urban/suburban, and R/S = rural/suburban 

d To!als may not equal 100 percent because we accepted questionnaire respondents' figures if they 
totaled 90-110 percent 

e Number of Vietnam era veterans identified as needing inpatient PTSD treatment in fiscal year 1985 
Note A blank indicates no response 
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Selected Characteristics of Vet Centers (as 
Reported in Questionnaire) 



Vet center 


Year began 
operation 


Location of 
center 


Location of 
ctient3 


Philadelphia, PA 


1982 


U 


u/s 


Phoenix, AZ 


1980 


u 


u/s 


Pittsburgh, PA 


1980 


u 


u/s 


Pleasantville, NJ 


1986 


s 


u/s 


Pocatello, ID 


1985 


R 


R/S 


Ponce, PR 


1985 


U 


c 


Portland, ME 


1979 


U 


u/s 


Portland, OR 


1980 


U 


u/s 


Prescott, AZ 


1985 


R 


R/S 


Provo, UT 


1984 


U 


R/S 


Queens, NY 


1985 


U 


U/S 


Rapid City, SD 


1982 


R 


U/S 


Reno, NV 


1981 


R 


R/S 


Richmond, VA 


1982 


U 


U/S 


Rio Piedras, PR 


1980 


U 


U/S 


Riverside, CA 


1982 


S 


c 


Roanoke, VA 


1985 


R 


R/S 


Rochester, NY 


1986 


U 


U/S 


Sacramento, CA 


1985 


U 


U/S 


Salenn-Corvallis, OR 


1986 


s 


• 


Salt Lake City, UT 


1980 


u 


u/s 


San Antonio, TX 


1980 


u 


c 


San Antonio, TX 




u 


u/s 


San Bernadmo CO, Ca 


1986 


s 




San Diego, CA 


1980 


u 


u/s 



GO 
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Selected Characteristics of Vet Centers (as 
Reported In Questionnaire) 



Vietnam era 
veteran 


Vietnam era veteran rais/ethnic oriain d 


Male 
Vietnam era 
veterans 
(percent) 


Distance to 
VA support 
facility 
(miles) 


Vietnam era 
veterans 
needing 
PTSD 
treatment* 


Distance to 

nearest 

designated 
PTSD unit 

\II1IIC9J 




(percent) 




population 


White 


Black 


Other 


71,500 


50 


40 


10 


80 


12 




OO 


105,000 


45 


10 


45 


95 


3 




o 
0 


121,307 


78 


20 


2 


98 


10 


c 


i on 

1 C\J 


70,000 


85 


12 


3 


99 


75 






35,000 


72 


1 


27 


95 


164 


1 1 


770 


7,000 


2 


0 


98 


99 


80 


C 1 




20,660 


93 


1 


6 


80 


65 


4S 




55,000 


92 


3 


5 


98 


6 


1? 


i?n 


11,000 


80 


1 


19 


97 


3 


> c 




20,000 


Q7 


i 
i 


o 
C 


90 


55 






37,500 


50 


30 


20 


99 


20 


10 




7,000 


85 


1 


14 


99 


30 


10 


1 (T") 


30,000 


84 


4 


12 


95 


2 


50 


2i 


91,000 


• 


• 


• 


• 


5 


60 


2u 


<?5,000 


0 


0 


100 


97 


1 


140 


1,045 


65,000 


40 


10 


50 


90 


30 


10 


600 


25,000 


6k 


37 


1 


96 


5 


10 


300 


44,000 


50 


25 


25 


90 


40 


2 


400 


120,000 


80 


12 


8 


93 


80 


• 


• 


70,660 


• 


• 


• 


• 


50 


• 


• 


70,000 


90 


2 


9 


99 


6 


20 


700 


50,000 


44 


7 


49 


98 


12 


15 


900 


53,000 


50 


3 


*7 


• 


6 


0 


800 


65,000 


40 


10 


50 


90 


30 


• 


• 


106,000 


60 


12 


28 


95 


12 


75 


800 



(continued) 

a Vet cen'er included in GAO review 



b U = urban, S = suburban, and R = rural 

C C = combined, U/S = urban/suburban, and R/S = rural/suburban 

d Totals may not eqi al 100 percent because we accepted questionnaire respondents figures if they 
totaled 90-1 10 percent 

e Number of Vietnam era veterans identified as needing inpatient PTSD treatment in f.scal year 1985 
Note A blank indicates no response 
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Selected Characteristics of Vet Centers (as 
Reported in Questionnaire) 





Year began 


Location of 


Location of 


fvl wCIHCl 


nDeratinn 


V V? 1 1 I V? 1 


clients 


Qon Dipon PA 


1985 


u 


U/S 


San FranCi^n PA 


1980 


u 


u/s 


Qo n ln<;p PA a 


1980 


s 


U/S 


Santa Rarhara PA 


1985 


s 


R/S 


Santa Pru? PA 


1985 


s 


R/S 


Santa Fp NM 


1985 


R 


R/S 


Sarasota Fl 


1985 


s 


R/S 


Savannah GA 


1986 


u 


R/S 


S'^ranton PA 


1985 


u 


U/S 


Seattle WA 


1979 


u 


U/S 


Silver Sonno MD 


1980 


s 


U/S 


Siniiv Pitv IA 


1981 


R 


R/S 


Sioux Falls, SD 


1980 


R 


R/S 


Spokane, WA 


1981 


u 


U/S 


Springfield, IL 


1985 


u 


U/S 


Springfield, MA a 


1982 


u 


c 


St Croix, PR 


1985 


R 


R/S 


St Louis, MO 


1981 


U 


U/S 


St Louis, MO 


1985 


S 


U/S 


St Paul, MN 


1980 


L 


U/S 


3t PetersL urg, FL a 


1980 


u 


U/S 


St Thomas, PR 


1985 


u 


U/S 


Syracuse, NY 


1995 


u 


c 


Tacoma, WA 


1979 


s 


U/S 


Tallahassee, FL 


1985 


u 


U/S 
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Selected Characteristics of Vet Centers (as 
Reported in Questionnaire) 



Vietnam era 

veterans Distance lo 



Vietnam era 
veteran 


Vietnam era veteran race/ethnic oriain* 


Male 
Vietnam era 
veterans 
(percent) 


Distance to 
VA support 
facility 
(miles) 


needing 
PTSD 
treatment 9 
(percent) 


nearest 

PTSD unit 
(miles) 




(percent) 




popuiaiion 


vvhite 


Black 


Other 


mc nnn 


60 


10 


30 


95 


25 


10 


500 


Pi i Qen 


45 


20 


36 


90 


5 


36 


25 


cn ono 
OU.UUU 


50 


12 


38 


95 


25 


25 


25 


ac nnn 


75 


5 


20 


95 


120 


• 


• 


oO.UUU 


30 


20 


50 


90 


100 


10 


100 


p nnn 
o.uuu 


20 


0 


80 


98 


65 


10 


900 


£0,DoU 


85 


10 


5 


96 


35 


3 


35 


oq nnn 
£d,uuu 


60 


35 


5 


95 


132 


5 


130 


1 non 


95 


3 


2 


98 


15 


10 


80 


1 1 n nnn 


65 


15 


20 


90 


4 


25 


50 


49 nnn 


50 


50 


0 


99 


7 


10 


170 


30,000 


74 


5 


21 


90 


90 


15 


650 


20,690 


90 


0 


10 


95 


3 


H 0 


400 


60,000 


90 


2 


8 


90 


4 


10 


300 


25,000 


60 


39 


1 


99 


100 


5 


200 


50,^00 


74 


15 


11 


90 


30 


25 


30 


30,000 


1 


54 


45 


98 


60 


10 


1,450 


100,000 


64 


30 


6 


96 


18 


100 


300 




60 


33 


7 


98 


25 


25 


300 


140,000 


90 


6 


4 


99 


8 


32 


170 


63,000 


75 


20 


5 


96 


9 


75 


9 


3,000 


20 


70 


10 


95 


150 


• 


• 


20,500 


65 


20 


15 


94 


2 


15 


100 


40,000 


73 


10 


17 


99 


12 


20 


12 


50,000 


80 


20 


0 


98 


115 


• 


• 



(continued) 

a Vet center included in GAO review 



b U = urban, S = suburban, and R = rural 

C C = combined, U/S = urban/suburban, and R/S = rural/suburban 

d Totals may not equal 100 percent because we accepted questionnaire respondents' figures if they 
totaled 90-1 10 percent 

e Number of Vietnam era veterans identified as needing inpatient PTSD treatment in fiscal year 1985 
Note A blank indicates no response 
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Selected Characteristics of Vet Centers (as 
Reported in Questionnaire) 



Vet center 


Year began 
operation 


Location of 
center 


Location of 
clients 


Tampa, FL 


1981 


U 


U/S 


Trenton, NJ 


1982 


U 


u/s 


Tulsa, OK 


1981 


u 


U/S 


Tuscon, AZ 


1980 


s 


u/s 


Washington, DC 


1980 


u 


u/s 


Wasilla, AK 


1980 


R 


R/G 


White Plains, NY 


1983 


s 


U/S 


White River JCT, VT 


1981 


R 


R/S 


Wichita, KS 


1980 


U 


U/S 


Wilhston, VT 


1980 


R 


R/S 


Wilmmgto',, DE 


1980 


U 


U/S 


Worchester, MA 


1985 


S 


c 
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Selected Characteristics of Vet Centers (as 
Reported In Questionnaire) 



Vietnam era 
veteran 


Vietnam era veteran race/ethnic oriain d 




Male 
Vietnam era 
veterans 
(percent) 


VA support 
facility 
(miles) 


Vietnam era 
veterans 

nopHlnn 
IICCUlllQ 

PTSD 
treatment* 
(percent) 


Distance to 
nearest 
designated 
PTSD unit 
(miles) 




(percent) 




population 


White 


Black Other 


39,000 


50 


35 


15 


80 


7 


15 


35 


54,280 


45 


50 


5 


90 


50 


50 


50 


48,300 


49 


10 


41 


oS 


60 


7 


300 


30,000 


50 


5 


45 


95 


18 


8 


130 


44,000 


30 


65 


5 


95 


5 


20 


200 


20,000 


97 


1 


2 


99 


60 


3 


3,000 


50,000 


60 


30 


10 


95 


15 


20 


13 


35,000 


99 


1 


0 


95 


1 


4 


100 


12,600 


55 


30 


15 


90 


4 


15 


125 


13,000 


96 


1 


3 


95 


90 


3 


150 


57,200 


65 


30 


4 


98 


4 


50 


30 


24,505 


85 


4 


11 


96 


65 


30 


50 



a Vet center included in GAO review 

b U = urban, 3 = suburban, and R = rural 

C C = combined, U/S = urban/suburban, and R/S = rural/suburban 

d Totals may not equal 100 percent because we accepted questionnaire respondents' fiqures if they 
totaled 90-1 10 percent 

e Number of Vietnam era veterans identified as needing inpatient PTSD treatment in fiscal year 1985. 
Note A blank indicates no response 
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GAO's Questionnaire Design and Methodology 



In February 1986, we sent a questionnaire to all vet centers and satellite 
centers tc obtain information concerning the administration and opera- 
tion of the Readjustment Counseling Program. This appendix contains a 
technical description of our questionnaire design, pretest procedures, 
and response rate. 



The questionnaire was designed to elicit vet center team leaders' and 
satellite coordinators' knowledge of and experiences with f he adminis- 
tration and operation cf their vet centers. Specifically, we asked team 
leaders and coordinators from each vet center reviewed about 

• their staffs' qualifications and training, 

« services provided by their staffs and others at the vet center, 

• characteristics of the v eterans served by the center, and 

• their relationship with referral agencies and other va facilities. 



Before the questionnaire was used, we pretested it at five vet centers 
representing locations that served urban, suburban, and rural Vietnam 
era veterans. In addition, the Readjustment Counseling Service director 
reviewed it. 

During the pretest, respondents completed the questionnaire while a 
trained gao observer noted unobtrusively the time the respondents took 
to complete each question and any difficulties they experienced. We 
used a standardized procedure to elicit the respondents' description of 
the various difficulties encountered as they completed each item; the 
standard procedure involved only nond ;r ect inquiries to ensure that we 
did not ask the respondents leading questions. 

Based on the pretest results, we revised the questionnaire to ensure that 
(1) the intended respondents could and would provide the information 
requested and (2) all questions were fair, relevant, easy to answer, and 
relatively free of design flaws that could introduce bias or error into the 
study results. We also tested to ensure that completing the questionnaire 
would not place too great a burden on the respondents. 

A total of 187 1 questionnaires were mailed, including 160 to vet centers 
and 27 to satellite centers. We received a 100- percent response rate. 



1 A 188th vet center, in Springfield, Va. f was not operating as of February 1986 Therefore, we did not 
ask its team leader to complete a questionnaire. 



Questionnaire Design 



Questionnaire Pretest 
and Response Rate 
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Determining the Accuracy of the Readjustment 
Counseling Program's Computerized Data Base 



Description of 
Sampling Methodology 

From the data base, we identified a universe of 3,999 clients for all 12 
vet centers. This universe represents the 12 centers' total number of cli- 
ents who had at least one visit within 180 days before July 31, 1985. 
This ensured that the clients selected would be relatively "cent ones. 
From this universe, we selected a random sample of 100 clients. 

For each of the clients in our sample, we selected eight personal and 
military service data elements to examine: sex of the veteran, date of 
birth, racial/ethnic status, marital status, education level, employment 
status, period of military service, and the extent of va service-connected 
disability status. We also examined the data elements describing clients' 
problems. 



Our objective was to determine the extent of the discrepancy between 
information in the Readjustment Counseling Service computerized data 
base and information in data processing source documents or other 
information contained in client folders at the 12 vet centers we visited. 



Verification of Data 
Elements 



To meet our objectives, we compared the dat-> elements (in the comput- 
erized data base) with the information on the source document in the 
client's folder. If a discrepancy existed, we considered this to be a 
keypunch error. For personal data and military service data, we also 
compared the data elements in the computerized data base with any 
other available information in the client folder. If a discrepancy existed, 
we considered this to be a substantive error. If there were no documents 
in the file with which to verify the data base, we assumed the data base 
was correct. We did not examine the data concerning client problems for 
substantive errors because there was not sufficient documentation in 
the files for us to verify that information. 



Estimating the 
Number of Errors 



From our sample, we identified 522 elements of client problem data and 
found two keypunch errors, resulting in a keypunch error rate of 0.4 
percent. From our sample, we also estimated the percentage of 
keypunch and substantive errors for each of the eight personal and mili- 
tary service data elements. Because we selected a random sample of cli- 
ents from the 12 centers visited, each estimate of the percentage of 
keypunch and substantive errors for the eight data elements has a sam- 
pling (that is, measurement precision) error. This is the maximum 
amount by which the estimate obtained from a random sample can be 
expected to differ from the true universe characteristic (value) we are 
estimating. Sampling errors are usually stated at a certain confidence 



Page103 1 15 GAO/HRD-87-63 Vet Counseling Centers 



ERIC 



Appendix IV 

Determining the Accuracy of the 
Readjustment Counseling Program's 
Computerized Data Base 



level — in this case, 95 percent. Thi? means the chances are 19 out of 20 
that if we reviewed the eight data elements for all active clients at the 
12 vet centers, the results would differ from the estimates obtained 
from our sample by less than the sampling errors of the estimates. 



A visual explanation of our sampling is given in table IV. 1. 





Table IV.1: Summary of Sample Used to Determine Keypunch and Substantive Errors 


Data element 


Universe Sample 


Percent of 
keypunch 
errors 


Sampling 
error +/- 
(percent) 


Percent of 
substantive 
errors 


Sampling 
error +/- 
(percent) 


3,999 100 


Sex of veteran 




4 


38 


1 


1.9 


Date of birth 




3 


33 


7 


50 


Racial/ethnic 




2 


27 


2 


27 


Marital status 




4 


38 


3 


33 


Education level 




1 


1 9 


14 


6.8 


Employment 




2 


27 


3 


33 


Period of service 




4 


38 


1 


1.9 


Extent of VA service-connected disability status 




3 


33 


16 


72 
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Comments From the Veterans Administration 




Office of the Washington DC 20420 

Administrator 

of Veterans Affairs 




Veterans 
Administration 



JUN 1 1 1987 

Mr. Richard L. Fogel 
Assistant Comptroller General 
Human Resources Division 
U.S. General Accounting Office 
Kashington, DC 20548 

Dear Mr. Fogel: 

This responds to your April 29, 1987 ? draft report VIETNAM 
VETERANS: A Profile of VA's Readjustment Counseling Program . The 
General Accounting Office (GAOJ examined specific aspects of the 
program to review the (1) number, characteristics, and problems of 
the veteran cl ients ; (2 ) services provided by the readjustment 
counseling centers (vet centers) and the qualifications and training 
of staff; (3) program management, oversight, and recordkeeping; 
(4) centers' coordination with post-traumatic stress disorder units; 
and (5) centers' relations with VA medical centers, community 
treatment programs, veterans, and the public. 

We endorse the GAO recommendation that the House and &nate 
Committees on Veterans' Affairs consider permitting VA to decide on 
a case-by-case basis whether or not to retain the vet centers in 
"storefront" locations instead of relocating them to VA medical 
facilities over a 2-year pe-iod, beginning October 1, 1987, as 
required by current law. This ill permit the Agency to consider 
sach center's changing needs and the method and location best suited 
to meeting those needs. 

The report contains recommendations to the VA on client followup, 
evaluating the quality of clinical and training support provided vet 
centers, anJ collaboration between vet centers and post-traumatic 
stress disorder units. Other recommendations concern regional 
officials' site visits to vex. centers and inclusion of vet center 
operations in internal and external reviews. The V\ either fully 
concurs in the recommendations, or concurs in principle. The 
enclosure contains detailed comments on each recommendation, as well 
as general comments on the report text. 




THOMAS K. TURNAGE 
Administrator 



Enclosure 
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ENCLOSURE 



VETERANS ADMINISTRATION COMMENTS ON THE 
APRIL 29, 1987, GAO DRAFT REPORT VIETNAM VETERANS: 
A PROFILE OF VA'S READJUSTMENT COONSISLIMfi PROGRAM" 



Cha pter 6 Recommendation : 

In view of their finding that the vet centers did not always conduct followup 
of their clients, GAO recommended that the Administrator direct the Chief 
Medical Director to clarify the importance of client followup, and if followup 
is considered important, monitor regional officials' site visit reports to 
determine whether it has been adequately conducted. 

The VA concurs. We plan to distribute revised guidance concerning followup 
requirements by the end of the current fiscal year. By the same target date, 
regional management officials* site visit reports will reflect an assessment 
and evaluation of followup activities. 

Chapter 7 Recommendations : 

The GAO concluded that aost vet centers and support facilities collaborated in 
some way on administrative, clinical, and training matters, but dis ^nce 
between the vet center and its support facility affected clinical and training 
collaboration. GAO recommended that the Administrator direct the Chief 
Medical Director to determine whether any outpatient clinic located closer 
than the current support facility could better provide clinical and training 
support to the vet center. 

We concur, and by July 31, 1987, expect to forward guidance to the field, 
instructing vet centers and VA outpatient clinics located in proximity to 
participate in each other's clinical and training activities. 

The report states that in addition to the law requiring, when appropriate, 
that post-traumatic stress disorder (PTSD) and vet center services be 
coordinated, the Special Committee on PTSD has indicated that close contact 
between vet centers and specialized PTSD inpatient units could improve 
treatment effectiveness. It is recommended that the Administrate/ direct the 
Chief Medical Director to strengthen collaboration between vet centers and 
PTSD units by requiring them to establish formal communication regarding all 
clients referred from one facility to the other. 

We concur, and by July 31, instructions will be sent to the field, requiring 
collaboration according to basic standards of sound clinical practice, 
increaseo information sharing between the PTSD units and the vet centers has 
already begun, including the participation of vet center staff in PTSD 
regional conferences. 

Chapter 8 Recommendations ; 

The report states that regional officials 1 site visits to vet centers are 
useful in managing program operations, but circumstances may prevent visits 
from being nade as frequently as is desirable. GAO recommends that the 
Administrator direct the Chief Medical Director to emphasize the need for 
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2. 



regional officials to sake their required site visits, mi tor whether the 
officials are Baking the visits as required, and, where not enough visits are 
beinfl Bade, request that the support facilities aonitor the administrative and 
clinical activities at the centers. 

We concur. IXiring April 1987, all regional BanageBent officials were 
instructed to complete the required number of adainistrative and clinical site 
visits for the current fiscal year. A acnthly report to Central Office from 
each region, documenting the number of visits accomplished in the fiscal year 
to date, was institute* We anticipate these steps will assure that target 
standards are uniformly met in the future. 

Chapter 9 Recommendation : 

GAO states that although the Readjustment Counseling Service established 
mechanisms to assure quality care, it has little assurance that the centers 
are providing quality care becauie of inadequate clinical recordkeeping 
practices and file review procedures* GAO recommends that the Administrator, 
through the Chief Medical Director, (1) require the Department of Medicine and 
Surgery regional offices to include the vet centers in their systematic 
external review prograas (SHIP); (2) require medical center directors to 
include vet centers in their systematic internal reviews (SIR); and (3) 
establish specific requirements for regional and team leader reviews of 
clinical files, including specifying the minimum frequency, magnitude, and 
documentation requirements, and requiring the reviewers to comment on quality 
of care provided to clients. 

We concur in the r irst part of th** recommendation, concerning SERP, and have 
begun implementation. By the end of the fiscal year, an ad hoc task force 
will provide recommendations for accomplishing SHIP reviews of vet centers. 
In addition, a SCEM (Standards, Criteria, and Evaluative Methodology— the 
major document used as criteria in conducting SERP surveys) for use in vet 
centei surveys, has been drafted and should be ready for publication by the 
end of September 1987 . 

We agree, in principle, with the second part of the recommendation-- that 
medical centers should review the support they provide to vet centers. 
Howe^i „ it would be inappropriate t.» require medical center directors to 
include vet centers in their SIR activity because they do not direct vet 
center operations. Systematic internal reviews by vet center team leaders and 
readjustment counseling regiona„ raarigeraent staff will automatically follow 
-rom implementing the new vet center SCEM for external reviews. Beginning in 
fiscal year 1988, the vet center liaison officer at each medical center will 
routinely receive the results of vet center SIR's, and medical facility 
directors may, as a local option, include vet centers in selected parts of 
their internal review program. 

We concur that there should be specific requirements for clinical file 
reviews. The SCCM for vet center operations will describe systematic internal 
review requirements, and the site visit report format will be revised to 
indicate minimum frequency and documentation requirements. 
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General Comments on the Report Text 



Now on p 33. 



Now on p . 



(401952) 



Chapter 4, page 57 and following , concerning accuracy of the program data base: 

The data system used from 1980 through 1984 was cumbersome, and the system 
promulgated in 1985 was even more so. Both systems were based on the 
generation of a separate form for every encounter between a staff member and a 
client, leading to the need to mail and keypunch tens of thousands of forms 
each month. Because of bulk, the system was difficult to audit and paperwork 
burdens on staff were inappropriate. Most problems described by GAO derive 
from these fundamental defects, and were compounded by the fact that both 
systems attempted to obtain data in three discrete areas: demographic 
information, clinical information, and workload. 

At the beginning of fiscal year 1987, a much more streamlined system was 
instituted. It concentrates oi workload data, with a minimum amount of 
clinical information contained in a 10-item problem list. This system 
requires staff to maintain a daily leg but eliminates the separate forms for 
every contact. The staff time thus freed can be devoted to recording clinical 
and demographic data in the individual counseling records. 

Chapter 5, page 57 and following , concerning training: 

We believe that when recently hired team leaders and satellite coordinators 
responded to the GAO questionnaire, they underreported the training they 
received. There were no instructions for staff to refer to their training 
conference agendas when completing the questionnaire, and it is likely that a 
certain proportion did not accurately report their orientation training. 
Nonetheless, GAO's findings concerning training are cause for concern, and 
regional management staff have been instructed to assure that newly hired 
staff uniformly obtain training in the key areas specified in TU>le 5.2 of the 
report. 
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Requests for copies of GAO reports should be sent to: 

U.S. General Accounting Off"? 
Post Office Box 6015 
Gaithersburg, Maryland 20877 

Telephone 202-275-6241 

The first five copies of each report are free. Additional copies are 
$2.00 each. 

There is a 25% discount on orders for 100 or more copies mailed to a 
single address. 

Orders must be prepaid by cash or by check or money order made out to 
the Superintendent of Documents. 
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